“Calhoun 


Institutional Archive of the Naval Postgraduate School 





Calhoun: The NPS Institutional Archive 
DSpace Repository 


Theses and Dissertations 1. Thesis and Dissertation Collection, all items 


2003-09 


An exploratory analysis of littoral combat 
Ships’ ability to protect expeditionary strike groups 


Efimba, Motale E. 


Monterey, California. Naval Postgraduate School 


This publication is a work of the U.S. Government as defined in Title 17, United 
States Code, Section 101. Copyright protection is not available for this work in the 
United States. 


Downloaded from NPS Archive: Calhoun 


Calhoun is the Naval Postgraduate School's public access digital repository for 


\§ D U DL EY research materials and institutional publications created by the NPS community. 
«iit Calhoun is named for Professor of Mathematics Guy K. Calhoun, NPS's first 


NY KNOX appointed -- and published -- scholarly author. 


LIBRARY Dudley Knox Library / Naval Postgraduate School 
411 Dyer Road / 1 University Circle 


http://www.nps.edu/library Monterey, California USA 93943 





NAVAL 
POSTGRADUATE 
SCHOOL 


MONTEREY, CALIFORNIA 


THESIS 


AN EXPLORATORY ANALYSIS OF LITTORAL 
COMBAT SHIPS’ ABILITY TO PROTECT 
EXPEDITIONARY STRIKE GROUPS 


by 


Motale E. Efimba 


September 2003 


Thesis Advisor: Thomas Lucas 
Second Reader: Russell Gottfried 





Approved for public release; distribution is unlimited 


THIS PAGE INTENTIONALLY LEFT BLANK 


Public reporting burden for this collection of information is estimated to average 1 hour per response, including 
the time for reviewing instruction, searching existing data sources, gathering and maintaining the data needed, and 
completing and reviewing the collection of information. Send comments regarding this burden estimate or any 
other aspect of this collection of information, including suggestions for reducing this burden, to Washington 
headquarters Services, Directorate for Information Operations and Reports, 1215 Jefferson Davis Highway, Suite 
1204, Arlington, VA 22202-4302, and to the Office of Management and Budget, Paperwork Reduction Project 
(0704-0188) Washington DC 20503. 


1. AGENCY USE ONLY (Leave blank) | 2. REPORT DATE 3. REPORT TYPE AND DATES COVERED 
September 2003 Master’s Thesis 


4. TITLE AND SUBTITLE: An Exploratory Analysis of Littoral Combat | 5. FUNDING NUMBERS 

Ships’ Ability to Protect Expeditionary Strike Groups 

6. AUTHOR(S) Motale E. Efimba 

7. PERFORMING ORGANIZATION NAME(S) AND ADDRESS(ES) 8. PERFORMING 
Naval Postgraduate School ORGANIZATION REPORT 
Monterey, CA 93943-5000 NUMBER 

9. SPONSORING /MONITORING AGENCY NAME(S) AND ADDRESS(ES) 10. SPONSORING/MONITORING 
N/A AGENCY REPORT NUMBER 


11. SUPPLEMENTARY NOTES The views expressed in this thesis are those of the author and do not reflect the official 
policy or position of the Department of Defense or the U.S. Government. 


12a. DISTRIBUTION / AVAILABILITY STATEMENT 12b. DISTRIBUTION CODE 
Approved for public release; distribution is unlimited 


13. ABSTRACT (maximum 200 words) 


This thesis uses an agent-based simulation model named EINSTein to perform an exploratory study on the feasibility 
of using Littoral Combat Ships (LCSs) to augment or replace the current defenses of Expeditionary Strike Groups (ESG). 
Specifically, LCS’s ability to help defend an ESGs in an anti-access scenario against a high-density small boat attack is 
simulated. Numbers of CRUDES (CRUiser, DEStroyer, Frigate) ships are removed and LCSs are added to the ESG force 
structure in varying amounts to identify force mixes that minimize ship losses. In addition, this thesis explores various 
conceptual capabilities that might be given to LCS. For example, helicopter/Unmanned Combat Aerial Vehicles 
(helo/UCAVs), Stealth technology, close-in high volume firepower, and 50+ knot sprint capability. Using graphical analysis, 
analysis of variance, and large-sample comparison tests we find that being able to control aircraft is the most influential factor 
for minimizing ship losses. Stealth technology is another significant factor, and the combination of the two is highly effective 
in reducing ship losses. Close-in high volume firepower is effective only when interacting with helo/UCAVs or stealth. 50+ 
knot sprint capability is potentially detrimental in this scenario. An effective total sum of CRUDES ships and LCS is between 
five and seven platforms. 

14. SUBJECT TERMS Einstein, LCS, Littoral Combat Ship, ESG, Expeditionary Strike Group, | 15. NUMBER OF 
Assured Access, Agent-Based Simulation PAGES 
386 


16. PRICE CODE 


17. SECURITY 18. SECURITY 19. SECURITY 20. LIMITATION 
CLASSIFICATION OF CLASSIFICATION OF THIS CLASSIFICATION OF OF ABSTRACT 
REPORT PAGE ABSTRACT 
Unclassified Unclassified Unclassified UL 
NSN 7540-01-280-5500 Standard Form 298 (Rev. 2-89) 
Prescribed by ANSI Std. 239-18 





THIS PAGE INTENTIONALLY LEFT BLANK 


il 


Approved for public release; distribution is unlimited 


AN EXPLORATORY ANALYSIS OF LITTORAL COMBAT SHIPS’ ABILITY 
TO PROTECT EXPEDITIONARY STRIKE GROUPS 


Motale E. Efimba 
Lieutenant, United States Navy 
B.S., United States Naval Academy, 1997 


Submitted in partial fulfillment of the 
requirements for the degree of 


MASTER OF SCIENCE IN OPERATIONS RESEARCH 


from the 


NAVAL POSTGRADUATE SCHOOL 


September 2003 
Author: Motale E. Efimba 
Approved by: Thomas Lucas 
Thesis Advisor 
Russell Gottfried 


Second Reader 


James N. Eagle 
Chairman, Department of Operations Research 


ill 


THIS PAGE INTENTIONALLY LEFT BLANK 


iv 


ABSTRACT 


This thesis uses an agent-based simulation model named EINSTein to perform an 
exploratory study on the feasibility of using Littoral Combat Ships (LCSs) to augment or 
replace the current defenses of Expeditionary Strike Groups (ESG). Specifically, LCS’s 
ability to help defend an ESGs in an anti-access scenario against a high-density small 
boat attack is simulated. Numbers of CRUDES (CRUiser, DEStroyer, Frigate) ships are 
removed and LCSs are added to the ESG force structure in varying amounts to identify 
force mixes that minimize ship losses. In addition, this thesis explores various 
conceptual capabilities that might be given to LCS. For example, helicopter/Unmanned 
Combat Aerial Vehicles (helo/UCAVs), Stealth technology, close-in high volume 
firepower, and 50+ knot sprint capability. Using graphical analysis, analysis of variance, 
and large-sample comparison tests we find that being able to control aircraft is the most 
influential factor for minimizing ship losses. Stealth technology is another significant 
factor, and the combination of the two is highly effective in reducing ship losses. Close- 
in high volume firepower is effective only when interacting with helo/UCAVs or stealth. 
50+ knot sprint capability is potentially detrimental in this scenario. An effective total 


sum of CRUDES ships and LCS is between five and seven platforms. 
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EXECUTIVE SUMMARY 


The United States’ naval expeditionary forces’ capabilities allow for quick 
reaction to hostilities, providing humanitarian aid, power projection, providing logistical 
support to forces ashore, as well as other operations. Oceangoing amphibious landing 
ships in Expeditionary Strike Groups (ESGs) transport troops, vehicles, and supplies all 
over the world wherever they are needed and provide military commanders greater 
flexibility in planning operations. However, if the amphibious ships encounter resistance 
while moving into position to perform operations, they need to fight their way into 


position for expeditionary operations. 


Due to amphibious ship design for maximizing the support of various amphibious 
waterborne and airborne operations, they have limited combat capabilities. These ships 
are armed only with Close In Weapon Systems (CIWS) and small arms (25mm 
machineguns and smaller) for own ship’s defense and have no major fire control system. 
However, amphibious aircraft carriers have, in addition to the above weapons, short- 
range NATO Sea Sparrow missiles and Rolling Airframe Missiles (RAM) for air defense. 
In order to counter littoral threats, where amphibious operations are performed, the Navy 
has transformed Amphibious Readiness Groups to ESGs by assigning dedicated 
combatant ships: cruisers, destroyers, and frigates (CRUDES), to protect the three 
amphibious ships. The CRUDES ships have tremendous firepower provided by 
extensive fire control systems, a wide array of anti-surface and anti-air missiles, and main 
gun(s). However, they require large crews and are expensive to build, and operate. 
Insufficient numbers of CRUDES ships in an ESG is a potential liability against high- 
density small boat attacks or coordinated surface action. This study investigates such a 


scenario. 


Looking to the future, areas in which we may perform amphibious operations do 
not tend to have large navies with large combatant ships—like destroyers or greater. 
Many costal nations defend their coasts at affordable cost with patrol boats and possibly 
missile corvettes, meeting a “green water” (littoral) navy requirement. Corvettes, coastal 
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patrol boats, and smaller vessels equipped with small arms and possibly four Exocet or 
Styx missiles are considerably less expensive than CRUDES ships and require a fraction 
of the crew. Also, the attack by a small, suicidal boat laden with explosives, rendering 
USS COLE out of action for nineteen months, showed that small boat attacks are a viable 
threat against the U.S. Navy. One question this study explores is: “How can the U. S. 
Navy effectively counter the high-density small boat threat?” 


Recently, the Navy has announced that it is creating a new type of ship, the 
Littoral Combat Ship (LCS), to augment carrier strike groups’ (CSG) and ESGs’ 
protection in coastal environments. These ships will be approximately the size of a 
corvette, possibly with options such as: the capability to control a helicopter or 
Unmanned Combat Aerial Vehicle (UCAV), an organic helicopter or UCAV, the latest 
stealth technology, the ability to shoot surface-to-surface missiles for high volume close- 
in firepower, and 50-plus knot sprint capability. Although they are oceangoing, they are 
envisioned to fight in the littoral area, where our ESGs operate, with greater flexibility, 
greater numbers, and at a lower cost than CRUDES ships. Other questions this study 
explores are: “Is the LCS a better option than the U.S. Navy’s current arsenal to 


defend ESGs? What capabilities enhance LCS’s performance?” 


This thesis uses an agent-based simulation model named EINSTein (Enhanced 
ISAAC (irreducible Semi-Autonomous Adaptive Combat) Neural Simulation Toolkit), 
developed by the Center for Naval Analyses (CNA), to explore these questions. 
EINSTein allows for investigation on how various LCS candidates might perform in a 
range of scenarios. In war, each unit has a Commanding Officer (CO) who has an overall 
mission and specific tasks pertaining to the unit or sub-group of units. However, each 
CO is different, with a different personality and perspective, and a characteristic way of 
fighting in the war. This is a major reason why EINSTein was chosen for this study; 
agent-based models allow for these personality differences. Two other reasons why 
EINSTein was chosen for this study are agent-based models are fast and tend to be 
stochastic, allowing for an analyst to explore many scenarios, capabilities and 
assumptions in a relatively short amount of time. Since agent-based models are 
stochastic, no two discrete runs are the same. Moreover, we get a distribution of possible 
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outcomes from any given input combination, simulating chance and Clausewitz’s “fog of 


” 


War. 


This thesis explores varying ESG ship force structures and LCS capabilities in an 
anti-access scenario where the ESG is traveling through a choke point to reach its 
amphibious operations area. Employing the same threat, a high-density small boat attack, 
observations are taken on ship survivability by platform type. Alternatives compared 
include the current CRUDES supported ESG, with and without organic armed aircraft, 
and LCS replacement of CRUDES platforms. Additionally, this study reviews different 
LCS design factors and their interaction, to determine which are most effective. 


Effectiveness is measured by the number of platforms lost by the force. 


By analyzing the data with Analysis of Variance (ANOVA) and large-sample 
comparison tests, aircraft are found to be the most influential factor in minimizing ship 
losses, with or without LCS. Furthermore, this particular finding is consistent with the 
U.S. Navy’s decision to design the initial block of LCS with the capability to employ and 
support an organic helicopter. For LCS, stealth technology is another significant factor, 
and the combination of stealth and air capability are effective in reducing ship losses. 
However, designing a hangar on a ship could reduce a ship’s stealthiness. Therefore, if 
stealth and aircraft are considered for LCS design, planners may opt for LCS to possess 
aircraft control capability while a larger ship (amphibious aircraft carrier or CRUDES 


ship) provides aircraft with logistical support. 


Close-in high volume firepower on board LCS is effective only when interacting 
with helo/UCAVs or stealth. This capability is a good choice if aircraft or stealth (not 
both) can be combined with another capability. However, all three capabilities employed 
can effectively eliminate ship losses. A 50-plus-knot sprint capability is potentially 
detrimental in this scenario when LCS platforms depart from the mutual force defense. 
When LCS operates within the strike group, defending against attackers, enhanced speed 
is no factor due to stationing requirements of remaining in a smaller area and staying with 


slower ships. An effective total sum of CRUDES ships and LCS is between five and 
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seven platforms. It is recommended that at least one of these platforms be a CRUDES 
ship for air defense capability, added command and control, and fire support for 


amphibious operations. 


EINSTein is an abstraction of fleet tactical warfare. The thesis spends a fair 
amount of discussion time to draw the connection between agent activity and shipboard 
operations. Nevertheless, its depiction of the effects of design considerations rings 
plausible for this scenario. A properly designed experimental study accounted for 
individual factors and interactions. It yielded results that enable analytical approaches, 
warfare designs and alternatives to be compared. This research provides a quantitative 
basis for further, higher resolution studies that should consider the measurable benefits of 
air capability and stealth and the relative ineffectiveness of tactical speed for this new 


littoral combatant ship. 
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I. INTRODUCTION AND PROBLEM 


A. INTRODUCTION 

1. Amphibious Operations 

The United States’ naval expeditionary forces’ capabilities allow for quick 
reaction to hostilities, providing humanitarian aid, power projection, providing logistical 
support to forces ashore, as well as other operations. Oceangoing amphibious landing 
ships in Expeditionary Strike Groups (ESGs) transport troops, vehicles, and supplies all 
over the world wherever they are needed and provide military commanders greater 
flexibility in planning operations. However, if the amphibious ships encounter resistance 
while moving into position to perform operations, they need to fight their way into 


position for expeditionary operations. 


According to the Joint Doctrine for Amphibious Operations, amphibious 
operations “can be generally broken down into five major types: assaults, withdrawals, 
demonstrations, raids and other amphibious operations.”! Amphibious assaults involve 
moving landing forces from ships to a hostile or potentially hostile shore. An amphibious 
withdrawal is the extraction of friendly forces from a hostile or potentially hostile shore 
to a ship. Amphibious demonstrations are shows of force “to deceive with the 
expectation of deluding the enemy to a course of action unfavorable to it.”2 On the other 
hand, amphibious raids are swift incursions to or temporary occupations of an objective, 
followed by a planned withdrawal. Other amphibious operations consist of 
noncombatant evacuation operations, foreign humanitarian assistance and logistic support 


of forces ashore.3 


Amphibious ships have been designed to support these missions. They have 
built-in stern wells that are wide enough to allow Landing Craft Air Cushion (LCAC) and 
utility landing craft (LCU) to enter and transport Marines, Marine equipment, other 


passengers or amphibious operation equipment. Also, all amphibious ships have flight 





1S. A. Fry, Joint Publication 3-02: Joint Doctrine for Amphibious Operations (Washington, DC: Joint 
Staff, 2001), I-2. 


2 Tbid., I-2. 
3 Ibid., I-3. 


decks to support air amphibious operations. Amphibious ships are armed only with Close 
In Weapon Systems (CIWS) and small arms (25mm machineguns and smaller) for self- 
defense and have no major fire control system. The exceptions are amphibious aircraft 
carriers which have, in addition to the above weapons, short-range NATO Sea Sparrow 
missiles and Rolling Airframe Missiles (RAM) for air self-defense.4 

2. Amphibious Asset Protection, from ARGs to ESGs 

Amphibious ships are not designed for fighting hostile naval forces, especially 
highly maneuverable patrol craft.5 Increasing this mission capability would decrease 
available shipboard space for supplies and Marine forces, the focus of the ships’ mission. 
The design of amphibious ships left Amphibious Readiness Groups (ARGs) (composed 
of three amphibious ships) vulnerable to attacks by littoral countries, in particular, surface 
navy and land-based air action. ARGs’ primary organic offensive weapons against 
surface navy action were small arms. The amphibious aircraft carriers have short range 
NATO Sea Sparrow and RAM for own ship’s defense if attackers use surface-to-surface 
missiles. The Emergency Defense of the Amphibious Task Force (EDATF) is another 
available defensive entity in an ARG. The EDATF is made up of Marine AV-8 Harrier 
jump jets, AH-1 Cobra helicopters and UH-1 Iroquois helicopters, which can swiftly 
defeat enemy forces in the air or on the water.6 However, the drawback of the EDATF is 
that all the aircraft need to be in the air or quickly have safe wind direction and speed for 
launching from the carriers. Also, employing the EDATF takes away air assets, fuel, and 
ammunition originally apportioned to the Marine Air-Ground Task Force (MAGTF) for 
ground operations. ARGs required better offensive capabilities and layered defense 


against surface threats. 


4 Norman Polmar, The Naval Institute Guide to the Ships and Aircraft of the U.S. Fleet (Annapolis, 
MD: Naval Institute Press, 1993) 160-181. 


5 Norman Polmar, The Naval Institute Guide to the Ships and Aircraft of the U.S. Fleet (Annapolis, 
MD: Naval Institute Press, 1993) 160-181. 


6 John Jamison, “Marines and Sailors Recreate History with Emergency Defense Bent on Protecting 
the Amphibious Task Force, ” Marines Online, March 1997. Available from the World Wide Web @ 
http://www.hqmc.usme.mil/marines.nsf/0/5a6b781 1d5841c9f8525645d00750a32?OpenDocument. 
Accessed 30 August 2003. 
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In order to counter littoral threats, the Navy has transformed ARGs to 
Expeditionary Strike Groups (ESGs) by assigning dedicated combatant ships: cruisers, 
destroyers, and frigates (CRUDES), to protect the amphibious ships.7 These ships have 
tremendous firepower provided by extensive fire control systems, a wide array of anti- 
surface and anti-air missiles, and main gun(s) with barrel sizes of 76mm or greater. 
However, they require large crews and are expensive to build and operate. For example, 
AEGIS Destroyers have a crew of 325 sailors and cost approximately $930 million per 
ship ($CY93).8 Crew requirements and costs of the CRUDES ships restrict their 
numbers in the fleet, and so only three are assigned to ESGs. An insufficient number of 
CRUDES ships in an ESG is a potential liability against high-density small boat attacks 
or coordinated surface action.? This study investigates such a scenario. 

3. Sea Base Protection 

Once forces are ashore, the vessels providing the sea base for such ground forces 
remain on station to support operations at the objective. The sea base, composed of the 
amphibious ships from the ESG and potentially maritime preposition supply ships, is 
vulnerable to surface threats. The maritime preposition supply ships are logistical ships 
that, with no weapons listed, have less defensive fighting power than any of the ships in 
an ESG.10 The sea base relies on the protection of the CRUDES ships assigned to the 
participating ESG and the sea base is set up well after the Navy establishes sea control for 
the particular littoral area. However, high-density small boat attacks remain a hazard for 
the duration of an operation. 

B. PROBLEM 
1. Probable Threat 
Looking to the future, areas in which we may perform amphibious operations do 


not tend to have large navies with large combatant ships—like destroyers or greater. 





7 Deep Blue, Expeditionary Strike Force Concept: Far ... From the Sea the Power of Teamwork. 
(Sherman Oaks, CA: Areté Associates, 2003) 2-6. 


8 Norman Polmar, The Naval Institute Guide to the Ships and Aircraft of the U.S. Fleet (Annapolis, 
MD: Naval Institute Press, 1993) 105, 125, 136, 147. 


9 Jessica Davis, “New Expeditionary Strike group to Enhance Navy-Marine Corps Team,” Navy 
Newsstand, December 2002. Available from the World Wide Web @ 
http://www.news.navy.mil/search/display.asp?story_id=9403. Accessed 25 July 2003. 





10 Norman Polmar, The Naval Institute Guide to the Ships and Aircraft of the U.S. Fleet (Annapolis, 
MD: Naval Institute Press, 1993) 289-292. 


Many costal nations will have patrol boats and possibly missile corvettes because of costs 
and the need for only a “green water’ (littoral) navy. These nations defend their coasts 
well at an affordable cost. Corvettes, coastal patrol boats and smaller vessels equipped 
with small arms and possibly four Exocet or Styx missiles are considerably less 
expensive than CRUDES ships and require a fraction of the crew.!! 12 Consequently, 
these countries can field a more abundant fleet of smaller ships for the price of one or two 
CRUDES ships. The attack by a small, suicidal boat laden with explosives, on USS 
COLE showed that small boat attacks are a viable threat against the US Navy. The attack 
rendered USS COLE out of action for nineteen months.!3_ One question this study 
intends to explore is: “How can the U. S. Navy effectively counter the high-density 
small boat threat?” 

2. LCS Option 

Recently, the Navy has announced that it is creating a new type of ship, the 
Littoral Combat Ship (LCS), to augment carrier strike groups’ (CSG) and ESGs’ 
protection in coastal environments.!4 These ships will be approximately the size of a 
corvette, possibly with options such as: the capability to control a helicopter or 
Unmanned Combat Aerial Vehicle (UCAV), an organic helicopter or UCAV, the latest 
stealth technology, the ability to shoot surface-to-surface missiles for high volume close- 
in firepower, and 50-plus knot sprint capability.!5 Although they are oceangoing, they 
are envisioned to fight in the littoral area, where our ESGs operate, with greater 


flexibility and numbers than other combatant CRUDES ships. In addition, the LCS is 


11 Norman Polmar, The Naval Institute Guide to the Ships and Aircraft of the U.S. Fleet (Annapolis, 
MD: Naval Institute Press, 1993) 103-145, 206. 


12 John Pike, “Pohang (PCC Patrol Combat Corvette),” Global Security.org, July 2002. Available on 
the World Wide Web @ http://www.globalsecurity.org/military/world/rok/pohang.htm. Accessed 16 
September 2003. 


13 David Icenhour, “Keys to the County Presented Aboard USS COLE,” Alexander County News 
Release, July 2002. Available from the World Wide Web @ 
http://www.co.alexander.nc.us/news/2002%20News%20Releases/Key%20to%20the%20County%20USS% 
20Cole.htm. Accessed 25 July 2003. 








14 Sandra I Erwin, “Littoral Combat Ship Moving Closer to Reality,” National Defense Magazine, 
April 2003. Available from the World Wide Web @ 
http://www.nationaldefensemagazine.org/article.cfm?Id=1079. Accessed 20 August 2003. 





15 Naval Warfare Development Command. Littoral Combat Ship Concept of Operations Development 
SITREP (Newport, RI: Naval Warfare Development Command, November 2002). 


4 


envisioned to have a lower cost and a smaller crew per ship than current escort ships.!6 17 
However, the addition of a new combat system may not necessarily yield the desired 
results or efficiencies. Other questions this study intends to explore are: “Is the LCS a 
better option than the U.S. Navy’s current arsenal to defend ESGs? What 
capabilities enhance LCS’s performance?” These questions are answered in the Data 
and Analysis chapter. 

C; WHY AGENT BASED SIMULATION? 

There are no easy answers to the questions posed above. In particular, there are 
tremendous uncertainties about what situation, where and whom ESGs might have to 
fight when LCSs are proposed to deploy in the fleet. Furthermore, we do not know what 
equipment and accompanying tactics potential threats might use. Simulation is a way to 
explore such questions. Running simulations allows for investigation on how various 


LCS candidates might perform in a range of scenarios. 


Agent-based models are types of simulations that have recently been used to help 
explore questions like those above. Agent-based simulations create entities that perform 
various actions. Each agent simulates a unit (a soldier, aircraft, tank, ship, armored 
vehicle, artillery, etc.) that acts (move, sense, shoot, communicate, etc.) autonomously or 
cooperatively. The overriding missions for each unit in the simulation are to fight, 
survive, make sure the agent’s teammates survive and destroy the enemy. Real war is 
similar. In war, each unit has a Commanding Officer (CO) that has an overall mission 
and specific tasks pertaining to the unit or sub-group of units. However, each CO is 
different, with a different personality and perspective, and a characteristic way of fighting 
in the war. This is a major reason why an agent-based model was chosen for this study; 


agent-based models allow for these personality differences. 


Two other reasons why an agent-based model was chosen for this study are agent- 
based models are fast and tend to be stochastic. A discrete run in an agent-based model 


will usually take no longer than a minute. This speed allows an analyst to explore many 





16 U.S. Navy, Department of Defense Information Paper: Background Assumptions on 30 Year 
Shipbuilding Plan, September 2003. 


17 Sandra I Erwin, “Littoral Combat Ship Moving Closer to Reality,” National Defense Magazine, 
April 2003. Available from the World Wide Web @ 
http://www.nationaldefensemagazine.org/article.cfm?Id=1079. Accessed 20 August 2003. 


2 





scenarios, capabilities and assumptions in a relatively short amount of time. Since agent- 
based models are stochastic, no two discrete runs are the same. Moreover, we get a 
distribution of possible outcomes from any given input combination. The variability 
simulates chance and Clausewitz’s “fog of war.” For these reasons this thesis utilizes the 


agent based simulation, EINSTein, developed by the Center for Naval Analyses (CNA). 


Hf. MODEL AND SIMULATION 


A. INTRODUCTION 

This chapter explains the EINSTein model, discusses the testing scenario, and 
goes over the assumptions and factors used in this study. The EINSTein section talks 
about the model, its strengths and its limitations. The anti-access scenario and baseline 
personalities and capabilities are explained in the scenario section. The assumptions and 
factors section discusses key assumptions made in this study and starts to describe the 
factors that are explored. 
B. EINSTEIN 

1. Model 

Enhanced ISAAC (Irreducible Semi-Autonomous Adaptive Combat) Neural 
Simulation Toolkit (EINSTein) will be used to gain insights to answer the questions of 
and possible trade offs between force composition and options. Andrew Ilachinski 
created EINSTein to be an artificial-life laboratory (Agent-based simulation) for 
exploring self-organized emergence in land combat.!8 Greg Cox of the Center for Naval 
Analysis modified it for use in naval warfare, which will be discussed later in this 


chapter. 


EINSTein is a model that is a stochastic time-step simulation. Time-step 
simulations break time into equal periodic increments. For example, if an agent moves 
three squares per time-step, then an agent will move to a new square three squares away 
from its current position at the next time-step. This is similar to what a knight can do in 
chess. The knight, and agent, never is located in any of the squares between its current 
position and future position but moves (like teleportation) from the current position to the 


future position. Unlike chess, all the agents in EINSTein may move simultaneously at 





18 Andrew Ilachinski, [SSAC/EINSTein: An Artificial-Life Approach to Land Combat (Alexandria, 
VA: Center For Naval Analyses, February 2003). Available from the World Wide Web @ 
http://www.cna.org/isaac/, Accessed 28 February 2003. 
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every time step. EINSTein uses ISAAC agents that can represent individual combat units 
from troops, to aircraft, to capital ships.19 ISAAC agents contain four main 


characteristics: 
Doctrine: a default local-rule set specifying how to act in a generic environment 
Mission: goals directed behavior 


Situation Awareness: sensors generating an internal map of the environment 





Adaptability: an internal mechanism to alter behavior and/or rules20 


These characteristics are appropriate for naval warfare. The doctrine 
characteristic is in keeping with the U.S. Navy’s doctrinal approach of every ship having 
a set of standard operating procedures (SOP) and battle orders, which give ship COs 
(Commanding Officers) and their crews guidance on what actions to take for various 
situations. Naval Strike Group Commander’s intentions, which contain the battle group 
goals, are simulated in this model by the mission characteristic. The situational 
awareness characteristic is appropriate in simulating the bridge and Combat Information 
Center (CIC, tactical display room) working in concert using radars, chart position fixes, 
visual observations and tactical data link information to maintain the battle space picture 
for the ship. EINSTein’s adaptability characteristic models a CO and the crew’s ability 


to take calculated risks is combat, given the battle space picture. 


The EINSTein battlefield is a two dimensional area where no two agents occupy 
the same position. The agents, only red or blue, are initially positioned in either a 
formation that the user specifies or at random. Both sides (red and blue) have a single 
“flag” that symbolizes a tactical objective to gain or defend. Agents exist in one of three 
states: alive (undamaged), injured (damaged), or killed (dead). A set of distinctive 
personalities and abilities can be defined for squad members existing in each state. Each 


agent has a set of operating characteristics (sensor range, firing range, communications 


19 Andrew Ilachinski, [SSAC/EINSTein: An Artificial-Life Approach to Land Combat (Alexandria, 
VA: Center For Naval Analyses, February 2003). Available from the World Wide Web @ 
http://www.cna.org/isaac/. Accessed 28 February 2003. 





20 Andrew Ilachinski, Towards a Science of Experimental Complexity: An Artificial-Life Approach to 
Modeling Warfare (Alexandria, VA: Center For Naval Analyses, February 2000). Available from the 
World Wide Web @ http://www.cna.org/isaac/, Accessed 28 February 2003. 
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range, and communications weight, 1.e. level of information) within which it senses and 
assimilates simple forms of local information, and a personality, which determines the 


general manner in which the agent responds to its environment.?! 


The agents are grouped into squads. Each side (red and blue) can have up to ten 
squads. Agents in a particular squad have the same set of personalities, abilities and 
operating characteristics. This is similar to COs of ships in the same class using the same 
doctrine when operating in a battle group. Also, ships in a class will have virtually the 
same operating and fighting capabilities. In a fleet there is little difference in the tactics, 
techniques and procedures (TTP) from one cruiser to another cruiser. On the other hand, 
there is a major difference between the SOPs of a cruiser and an Amphibious ship 
because of the different radar systems, weapon systems, maneuverability and size, to 
mention just a few reasons. 

a. Personality and Movement 

The personalities of agents are defined by a six-component (personality 
weight) vector, w= [W1, W2, ..., We]. The weights can be any real number. A positive 
personality weight represents an attraction. On the other hand, negative weights represent 
repulsion. Weights of zero represent indifference. The six components that an agent has 


the propensity to be attracted to move toward or a desire to move away from are: 
w= desire to move to or from alive friendly agents (like-colored agents) 


W2 = desire to move to or from alive enemy agents (different colored 


agents) 
W3 = desire to move to or from injured friendly agents 
w4 = desire to move to or from injured enemy agents 
Ws = desire to move to or from friendly flag 


We = desire to move to or from enemy flag 





21 Andrew Ilachinski, [SSAC/EINSTein: An Artificial-Life Approach to Land Combat (Alexandria, 
VA: Center For Naval Analyses, February 2003). Available from the World Wide Web @ 
http://Awww.cna.org/isaac/, Accessed 28 February 2003. 
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EINSTein takes each weight (wi) and divides it by the total personality 
weight (the sum of the absolute value of the individual weights= j |wi|) to calculate the 
percentage of the total personality weight that w; merits. EINSTein uses this percentage 
against other weights’ percentages, along with what the agent senses, to generate 
movement that maximizes the agent’s utility during a particular time-step. If there are 
multiple most enticing moves for an agent at a particular time-step, the agent will 
randomly choose one of them. See I[lachinski, ISSAC/EINSTein: An Artificial-Life 
Approach to Land Combat, http://www.cna.org/isaac/ for the details on how the value of 


potential moves are calculated. 


The CRUDES ships’ (agents’) alive personality vector in the anti-access 
scenario is 10, 40, 0, 40, 0, 10, for weights w; through we, respectively. If a CRUDES 
ship had an alive friendly ship to starboard and an alive enemy ship to port, it will desire 
to move toward the alive enemy ship. However, if a CRUDES ship is flanked in the 
same way by an alive enemy ship and an injured enemy ship, the agent will randomly 
choose between the two options. This choice simulates a CO’s judgment. Some CO’s 
might think that the injured enemy ship is less of a threat, therefore approaching and 
engaging the alive enemy ship would be the best decision. Other COs would think that 
the injured enemy ship is an easier threat to eliminate and would reduce the combined 
enemy fighting capability. So, approaching the injured enemy ship would be the better of 
the two decisions. EINSTein’s advancements allow for agents moving in a formation, as 


well. 


An agent’s personality may also be augmented by a set of meta-rules that 
take into account its environmental conditions. The class-1 meta-rule prevents an agent 
from moving toward an enemy flag unless it is surrounded locally by a minimum number 
of friendly agents. The class-2 meta-rule prevents an agent from moving toward friendly 
agents once a threshold number of friendly agents surround the agent. Other rules deal 
with engaging in combat, retreat, pursuit, support, and holding position. These 
personalities and meta-rules serve as battle orders from a strike group commander to 
subordinate unit commanders. In the test runs of the anti-access scenario, the amphibious 
ships often maneuvered into combat with the CRUDES ships rather than following 


behind the CRUDES ships. To improve fidelity, amphibious ships have a cluster meta- 
10 


rule set established so they have a greater desire to cluster than approach the enemy flag. 
The clustering meta-rule is set so that the amphibious ships desire to cluster with at least 
four friendly ships. Considering that there are only three amphibious ships in an 
Expeditionary Strike Group (ESG), the amphibious ships follow CRUDES ships and 
LCSs to the objective, following the meta-rule to cluster with a minimum of four friendly 
ships. 

b. Combat 

EINSTein’s combat uses an agent’s maximum number of targets to engage 
to determine how many targets to randomly choose for targeting that are within the 
agent’s firing range. Then, EINSTein uses uniform random variables against an agent’s 
single shot probability of hitting to determine if the agent hits the targeted agents. If an 
agent is hit its state is degraded. The degradation progresses from alive to injured, then 
injured to dead. Once an agent degrades to the injured state, it uses the set of injured 
personality traits and ability traits defined for its squad’s injured state. If an agent is 
degraded to the state of dead, the agent ceases to exist. Fratricide is a possibility that can 
be enabled in EINSTein’s combat simulation, adding to the realism. Harpoon (BGM-84) 
is a great example of a weapon used by the U.S. Navy that has fratricide as a possible 
result. Although navy crews are trained to employ Harpoon to minimize fratricide, 
Harpoon’s seeker looks for and locks onto the first ship it can see while it is in terminal 
phase. It does not differentiate between friendly, enemy or neutral shipping. There are 
other weapons that navies employ that do not differentiate between targets. Human error 
and the “fog of war” coupled with these weapons bring about the possibility of fratricide. 

c. EINSTein for Naval Combat 

A snapshot of EINSTein being used for naval combat analysis is shown 
below in Figure 1. The picture is taken from Dr. Greg Cox’s, from the Center for Naval 
Analyses, simulation “Gamelet,” held at the Naval Postgraduate School. In this scenario, 
blue enemy ships are poised to defend the Northern Arabian Gulf (NAG) from red U.S. 
ships in a CSG starting in the Gulf Of Oman (GOO) trying to reach 
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their objective in the NAG. The four blue dots in Iran are shore missile batteries. The 
single red dot to the left of the “10” is an AWACS plane providing enemy position 
information to the red ships in the CSG.22 


Act 1, Scene 1: The baseline 
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Figure 1 Example of EINSTein Window 


To modify EINSTein for naval combat, Dr. Cox removed all the terrain 
aspects unless he wanted to create impassable land surrounding the water. He modeled 
capabilities and personalities to (abstractly) emulate real platforms. He used these 
platforms in a naval scenario where he and students explored the utility of LCS and 
possible LCS capabilities for augmenting CSG defense. The study of the “Gamelet” 
exposed insights on influential LCS factors and influential tactics that would be 


beneficial to defending a CSG from an enemy Surface Action Group (SAG). 


Dr. Cox’s “Gamelet” serves as a blueprint for this thesis. The battlefield, 
enemy small boats, and CRUDES ships were borrowed from the “Gamelet,” with slight 


modifications. The baseline LCS, firepower factor, stealth factor and speed factor are 





22 Greg E. Cox, EINSTein Visits the Persian Gulf (via Monterey, California): A Naval Requirements 
War ‘Gamelet’ Held at the Naval Postgraduate School 11-15 FEBRUARY 2002, (Alexandria, VA: Center 
for Naval Analyses, March 2002). 
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also borrowed from Dr. Cox’s “Gamelet.” This study took note of the strengths and 
weaknesses of using EINSTein to explore naval combat, and decided that EINSTein’s 
strengths greatly outweigh its weaknesses for exploratory purposes. 

2. Strengths 

EINSTein has proven to be a way to gain insights on combat and combat 
performance. Over the past two winter quarters at the Naval Postgraduate School, Dr. 
Cox has involved students in Joint Campaign Analysis in his exploratory study of LCS. 
He and students used EINSTein to simulate LCS’s participation in protecting a CSG in an 
anti-access scenario.23 The study demonstrated that agent-based models could effectively 
simulate naval warfare. The study encompassed in this thesis utilizes some of the 


techniques learned from Dr. Cox’s study. 


In terms of their personalities, agents act like COs in charge of their ships. All the 
COs know the operational objective, but each has slightly different methods for 
accomplishing the mission. Specific benefits include that the model is stochastic. A set 
of inputs will produce different outputs for each discrete simulation run, thus providing a 
range of outcomes. EINSTein, like many agent based models, is a quick model in which 
many runs can be performed in a short time (approximately ten seconds to perform one 
500 step run). This enables us to look at many scenarios and variables in a reasonable 
amount of time. Finally, additional naval studies were performed with EINSTein in the 


Naval Postgraduate School’s Joint Campaign Analysis class. 


Picking up where previous naval studies left off and making adjustments for this 
scenario was not difficult. EINSTein’s allowance for fratricide adds to the model’s 
ability to simulate combat. Weapon systems like harpoon missiles and small arms are 
fire-and-forget weapons that do not differentiate between friend and foe. Once those 
missiles reach a designated area they begin searching and then attack the first contact 
they acquire. Small arms fire travels in a fairly straight line, so rounds hit whatever is in 
their path. The fog of war and motion of the ocean limits a small arms operator’s ability 


to properly aim at opposing 





23 Greg E. Cox, EINSTein Visits the Persian Gulf (via Monterey, California): A Naval Requirements 
War ‘Gamelet’ Held at the Naval Postgraduate School 11-15 FEBRUARY 2002, (Alexandria, VA: Center 
for Naval Analyses, March 2002). 
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forces and adds to the possibility to fratricide. Fratricide is set in the model to a range of 
ten squares from a platform’s position with a one percent probability of hitting friendly 
forces. 

3. Limitations and Required Abstractions 

In general, EINSTein is a low-resolution model that is best at gleaning broad 
insights as opposed to detailed predictions. For this study, EINSTein’s notable 
limitations are its treatment of speed, time, ship performance capabilities, and aircraft. 
There are only five levels for speed (0, 1-4). The scale is fixed so EINSTein has relative 
size and speed limitations. For this study one level of speed will equate to 25 knots. An 
agent that simulates most ships will have a speed of 1, i.e. simulating 25 knots. Agents 
that simulate the fastest ships, those that can achieve approximately 50 knots, will have a 
speed of 2. Helicopters and UCAVs will have a speed of 4 to represent their ability to fly 
approximately 100 knots.24 25 Speed and ranges are relative to how one considers a time- 
step. This study uses one square on the EINSTein battlefield to equal one nautical mile 
(NM). Considering that it takes a CRUDES ship 25 time-steps to move 25 squares, 25 


time-steps will be considered an hour in the model. 


Although the time step aspect makes simulating real life easier, the simulation 
loses some of the fluidity of real life. Certain events, like an agent entering a sensor arc 
of another agent, could be missed if the event would have occurred in the period between 
time-steps. A ship or aircraft’s performance in the model depends on its abilities and 
personality, so inputs must be adjusted and tested to ensure proper reactions. Sometimes 
a personality vector does not take full advantage of the platform’s abilities. This study 
will use one set of personality vectors to a level that seemed reasonable for all 
capabilities. Using one set of personality vectors was done as a control mechanism in 


order to focus on the ship configurations and capabilities. 





24 Dennis Sorensen, Naval Unmanned Aerial Vehicles, (Patuxent River, MD: Navy Unmanned Acrial 
Vehicles- PMA263, September 2003). Available on the World Wide Web @ 
http://uav.navair.navy.mil/vtuav/default.htm. Accessed 5 September 2003. 


25 Norman Polmar, The Naval Institute Guide to the Ships and Aircraft of the U.S. Fleet (Annapolis, 
MD: Naval Institute Press, 1993) 441. 
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For the aircraft, there is more than one way to simulate a helicopter or UCAV in 
EINSTein. One approach is to create a squad of aircraft agents. The other is to increase 
the weapon range and sensor range of the ship that in real life would be controlling the 
aircraft. Both methods do not properly emulate an aircraft’s need to return to its base 
ship to replenish expended munitions. The first method’s aircraft never return to the ship 
to reload and the second sets both the ships’ and aircrafts’ weapons at the same capability 
in range and probability of hit. In method one, a squad of aircraft in the model will 
become fairly autonomous, sometimes allowing aircraft to fly outside of the safe aircraft 
flying distance from its controlling ship. The second method doesn’t take into account 
that the aircraft can be shot down, losing their benefits, and that the opposing forces have 
to target aircraft and ships separately. This is the most significant shortcoming in the 
model due to limited control of aircraft agents and a degree of abstraction. This study 
uses method | to simulate aircraft, taking advantage of their contribution, but capturing 


their vulnerability to enemy fire. 


Another drawback of EINSTein is that there is no way to add neutral shipping. 
The only agents that exist in this model are opposing red and blue agents. Neutral 
shipping complicates combat situations by adding more ships that need to be examined 
for neutrality or hostility and adding ships to avoid from shooting. Platforms on both 
sides have perfect battlespace knowledge of contact position, battle damage assessment 
on each contact, and IFF (Identification Friend or Foe, whether the platform a friend or a 
foe) inside of their sensor range, 
C. SCENARIO 

This study required plausible scenarios to properly examine the capabilities of 
LCS. The scenarios have to examine operations in littoral areas and properly flex the 
probable threats. This study focuses on surface threats. Considering how much damage 
a small boat with explosives inflicted to USS COLE (DDG 67) and the likelihood that 
most countries near potential ESG operating areas will only have small boats, this study 
uses the high-density small boat attack as the primary threat to the ESG. Another reason 


the high-density small boat attack was used in this study was because some of these small 
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boats, like Boghammer Patrol Boats, carry RPG (Rocket Propelled Grenades) and cruise 
missiles. Like the Exocet that took USS STARK (FFG 31) out of action, cruise missiles 


can deliver crippling damage to larger combat ships. 


The enemy force consists of one squad of thirty high-speed small boat agents. 
Their personalities and capabilities are the exact same as the high-speed small boat agents 
used in Dr Greg Cox’s previous studies. The enemy high-speed boats are envisioned to 
be a midpoint boat between the common motorboat with a machine gun and a Fast Patrol 
Boat (FPB 354).26 The model’s enemy high-speed boats’ key capabilities are shown 
below in Table 1. 


Movement per ; Sensor/Fire S S Phit 
F Staying Power 
time step range (no. engage) 


Squad 


HS Boats 





Table 1 Red Force High-Speed Boat Capabilities 


1. Red Force 

a. Enemy High-Speed Small Boat Capabilities 

When undamaged, a high-speed boat’s movement in this model is up to 
two squares per time step (approximately fifty knots). After receiving one direct hit, the 
high-speed boats transition from the undamaged to the damaged state. Undamaged high- 
speed boat’s sensors can detect up to fifteen NM, simulating low quality surface search 
radar and low quality CIC (tactical display room) with limited manning. The high-speed 
boat can shoot up to eight NM from its position. The shooting range models small arms 
and the occasional possibility of using an RPG or an Exocet missile. Also, the high- 
speed boats can engage one target per time-step with a five percent probability of hitting 
the target, which simulates the ability to only bring one weapon system to bear because of 
small crew size and the inaccuracy of using a human as the fire control system. The 
probability of hit may seem low for modern weapon systems. However, in EINSTein, 


each ship will fire weapons at all targets within its sensor and weapon ranges each time- 





26 Peene- Werft GmbH, Naval Shipbuilding: Fast Patrol Boat FPB 354, (Stralsund, Germany: Peene- 
Werft GmbH, September 2003). Available on the World Wide Web @ http://www.peene- 
werft.de/en/schiffe/d_fpb354.html#top. Accessed 16 September 2003. 
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step. The low values account for the probability that the target is actually engaged and 
hit—which includes the probabilities that the target is identified, tracked, attacked and 
hit. 


When damaged, the high-speed small boat agents’ movement is slowed to 
one square per time step, simulating degraded propulsion performance (approximately 
twenty-five knots). A damaged high-speed boat’s transition to a dead state occurs after 
receiving one direct hit. Damaged high-speed boat’s sensors can detect up to eight NM, 
simulating that the surface search radar is destroyed and the boat is using visual sensors. 
To simulate only having small arms and RPGs as weapons and injured operators the 
high-speed small boat agents can shoot up to four NM from the agent’s position, and can 
engage one target per time-step with a two and a half percent probability of hitting. 

b. Red Force Enemy High-Speed Small Boat Personalities 

The enemy high-speed small boat personalities are shown below in Table 
2. An undamaged high-speed small boat most desires to approach undamaged (alive) and 
damaged (injured) enemy (blue in this case) forces equally and desires to approach the 
enemy objective (enemy flag) half as much. The desire to approach the enemy objective 
helps to initiate an engagement between blue and red forces. These personalities fit in 
with an aggressive attack style expected from a high-density small boat attack. The boats 
seek out the enemy and then aggressively stay with the enemy until the enemy is 
destroyed. This personality also takes advantage of the high-density small boat attack’s 
numbers. The aggressiveness drives more small boats to flood the enemy combatant’s 
radar picture, making it harder for enemy combatants to target individual small boats— 
like a shark with a school of fish. A damaged high-speed small boat also seeks to engage 
undamaged and damaged enemy ships equally. These injured personalities are set as 
such because high-speed small boats will likely be already near blue forces when they are 


damaged. Red force boats focus only on destroying blue ships. 


Squad 





HS Boats 


Table 2. Red Force High-Speed Boat Personalities 
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2. Blue Force Capabilities 

The scenario this study examines is an ESG in an anti-access setting. ESG 
agents’ capabilities are listed below in Table 3. When undamaged, all the ESG agents 
move one square per time-step, simulating their ability to transit at approximately twenty- 
five knots. Taking into account the large size of amphibious ships and their defensive 
weapons, in this model, these platforms can take two direct hits before transitioning from 
the undamaged state to the damaged state. CRUDES ships tend to have a more capable 
defensive weapons suite so they have the capacity to take three direct hits before 
becoming damaged in this model. Note: this does not mean CRUDES ships can absorb 
three hits without damage, rather it is used to account for the CRUDES ship’s defensive 
weapons—1.e., many incoming missiles will be successfully countered by hard kill and 


soft kill measures. 





Movement per : Sensor/Fire S S Phit 
: Staying Power 
time step range (no. engage) 


Amphibs 


CRUDES 





Table 3 = Baseline Blue ESG Force Capabilities 


The baseline LCS is envisioned to have similar defensive capabilities as the 
enemy high-speed boats so it can only take one direct hit before transitioning from the 
undamaged state to the damaged state.27 In the model, amphibious ships and LCSs can 
detect contacts twenty NM away emulating higher quality surface search radars, tactical 
data links, and a CIC manned with a trained crew. CRUDES ships detect platforms 
within thirty NM of their position due to their ability to use quality radars (like the SPY-1 
and Combined Antenna System), use tactical data links, and having their CIC manned 


with a highly trained crew. 





27 Sandra I Erwin, “Littoral Combat Ship Moving Closer to Reality,” National Defense Magazine, 
April 2003. Available from the World Wide Web @ 
http://www.nationaldefensemagazine.org/article.cfm?Id=1079. Accessed 20 August 2003. 
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To simulate an amphibious ship and LCS being armed with small arms, as well as 
systems like CIWS and NATO Sea Sparrow (in surface mode), in the model amphibious 
ships and LCSs can shoot up to a distance of ten NM from their position. CRUDES 
ships, with their better weapon systems, like SM-2 (in surface mode) or Harpoon 
missiles, can shoot up to twenty NM from their position. Amphibious ships can engage 
two targets (thanks to greater manning) with a ten percent probability of hit (decent fire 
control). On the other hand, LCSs can only shoot one target (lower manning) with the 
same ten percent probability of hit. CRUDES ships, with their better combat and fire 


control suites, can shoot two targets with a fifteen percent probability of hitting them. 


Upon being damaged there is no change to the ship’s speed. Damaged 
amphibious and CRUDES ships can take two more direct hits before destruction, 
simulating their ability to take substantial amounts of damage before being sunk or 
completely knocked out of combat. Damaged LCSs, like the enemy high-speed boats, 
can only take one direct hit before being destroyed. In the model, amphibious ships and 
LCSs simulate having decreased radar ranges and a degraded tactical data link by 
limiting their detection range to ten NM from their position. CRUDES ships do the same 
by limiting their sensor detection range to twenty NM when damaged. Amphibious ships 
and LCSs have a firing range of seven NM to simulate the loss of some primary weapons 
with a better ability for fire control than the high-speed boats. CRUDES ships are 
expected to have one of their primary surface weapons when damaged, so their firing 
range is fifteen NM. All damaged ships can only engage one target. Amphibious ships 
and LCSs shoot with a five percent probability of hitting while CRUDES ships shoot and 
hit with a probability of seven-and-a-half percent. This lower probability simulates 
degraded fire control capability. ESG unit personalities will be discussed in the 
following section. Alternative LCS capabilities will be discussed in the next chapter. 

3. Anti-Access Situation and Blue Force Personalities 

The anti-access scenario simulates an ESG transiting through a choke point. A 
choke point is a narrow body flanked by land that connects two large bodies of water. 
There is little room for ships to maneuver in a choke point. The Straits of Gibraltar, the 
Formosa Straits and waterways in between the North Sea and the Baltic Sea are 
examples. ESGs will have to pass through one to reach some littoral areas so its ships 
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can perform amphibious operations. A group of ships transiting a choke point usually 
can only pass in a line or at the most two abreast. The exit of a choke point is an 
excellent place to deploy forces to resist transiting ships. Resisting forces can virtually 
cross the “T” by positioning their forces at the exit so that many of the resisting ships can 
shoot their weapons while the transiting force will only have a portion of their ships that 


can shoot weapons without risk of fratricide. 


This thesis analyzes an ESG transiting from its starting point in the GOO to its 
destination up in the NAG in an anti-access scenario. The ESG attempts to pass through 
the Straits of Hormuz while fending off a high-density small boat attack. The ESG (blue) 
agents’ personalities are shown below in Table 4. The individual weights add up to one 
hundred (2; |wi|=100) to ease recognition of the percentage of the total personality weight 
devoted to a component of the personality vector. When undamaged, amphibious ships 
in the model desire to move toward friendly undamaged friendly platforms with forty 
percent of the total personality weight, damaged (injured) friendly platforms with forty 
percent of the total personality weight, and the objective (enemy flag) with twenty 
percent of the total personality weight. The undamaged personality vector emulates 
amphibious ship COs’ desire to say with the protection of other ships while also desiring 
to approach the objective to perform amphibious operations. Damaged amphibious ships 
desire to be near undamaged platforms for safety is shown by increasing that weight to 
forty five percent of the total weight and lowering the desire to approach the objective to 
fifteen percent of the total weight. However, the meta-rule for the amphibious ship, 
explained in Chapter I, section A-l-a, paragraph 3, makes the amphibious ships most 


desire to cluster with at least four platforms. 


Anti-Access Personalities 


Amphibs 


CRUDES 
Helo/UCAV 





Table 4 Blue ESG Force Anti-Access Personalities 
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Undamaged CRUDES ships’ desire to engage enemy ships undamaged and 
damaged cover forty percent of the total personality weight each. Their tendencies to 
move toward fellow alive ships and approach the objective encompass ten percent each. 
This study uses an aggressive CRUDES CO personality to better protect the amphibious 
ships. Their mission is to seek out and eliminate the threat so that the amphibious ships 
can perform their mission out of harms way. The undamaged CRUDES ships try to 
engage enemy ships before the amphibious ships are inside the enemy ships weapons 
range. When damaged, CRUDES ships become less aggressive and try to take advantage 
of numbers while still trying to engage the enemy. Now, thirty percent of their 


personality weight is devoted to trying to finish off damaged enemies. 


CRUDES COs’ desires to join with undamaged friendly forces, to join with 
injured friendly forces, and to engage undamaged enemy ships, are twenty percent each, 
balancing desires to protect the ESG and join with friendly forces for added protection. 
CRUDES ships also have a meta-rule enabled to not proceed to the objective in the NAG 
unless they are near three other friendly platforms. This meta-rule was enabled so that 
the CRUDES ships would not leave the amphibious ships behind on their way to the 
objective. The meta-rule was not enabled on the LCSs because it would be futile when 
the LCSs have the speed factor enabled and can move twice the speed of the amphibious 
ships that try to follow. This has implications for the simulated LCS activity, as 
discussed in Chapter IV. Amphibious ships make it to the objective in most runs when 


they and another platform survive. 


LCS COs, when commanding an undamaged ship, also have an aggressive 
personality. They desire finishing off damaged enemies most, with forty percent of the 
total personality weight given to this task. Next is their desire to engage undamaged 
enemy ships, covering twenty five percent of the weight. The strike group commander’s 
intent that LCSs scout ahead is forced on LCSs by giving their COs’ desire to approach 
the objective fifteen percent of the total weight. Finally, the LCS COs desire to join with 
friendly forces, undamaged and damaged, with ten percent of the total weight each. 
Undamaged helo/UCAVs (helicopter/Unmanned Combat Aerial Vehicles) are given the 


same personality vector as an undamaged LCS. 
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Damaged LCSs have less aggressive COs. Their COs most desire to finish off 
damaged enemy ships, but this comprises only thirty percent of the total personality 
weight. The COs desire to join the protection of friendly forces, damaged and 
undamaged, with twenty percent apiece. They desire to approach the objective and 
undamaged enemy ships with fifteen percent of the total weight each. Damaged 
helo/UCAVs also aggressively desire to engage damaged enemy ships with thirty percent 
of their total personality weight, however they desire to seek the protection of undamaged 
friendly forces with the same percentage of the total weight. The balance between 
aggressive and conservative allows for the possibility of an aggressive pilot protecting the 
ESG at all costs or a conservative pilot attempting to maximize the number of friendly 
forces engaging enemy forces. Like damaged CRUDES ship COs and damaged LCS 
COs, damaged helo/UCAV pilots desire to join damaged friendly forces with twenty 
percent of the weight, and desire to both approach the objective and engage undamaged 


enemy ships with fifteen percent. 


The battlefield is shown in Figure 2. The initial blue center of gravity, referred to 
in EINSTein as the blue flag, is positioned in the GOO and the red flag is positioned in 
the NAG. Blue platforms and red platforms are randomly positioned near their respective 
flag for each run. Initially, personalities drive the ESG forces (blue) toward the NAG and 
the enemy high-speed small boats (red) toward the GOO. They meet at the northbound 
exit of the Strait of Hormuz and engage in a fight-to-the-finish. At the end of the run 
cycle (500 time steps), data is collected and the battlefield is randomly reset for the next 
run until a run set is completed. The line above the “10” to the left of the red forces 


shows the length of 10 NM (squares) in the model. 
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Figure 2. Anti-Access Battlefield 


D. ASSUMPTIONS AND FACTORS 

1. Assumptions 

As with all models, there are by-products of the simulation and assumptions made 
with this study. Some by-products, like how many EINSTein time-steps represent an 
hour of real time, have been mentioned above. That there is no change in personality, 
even though a ship might have different capabilities, isolates the effects of changing the 
capabilities even though the personality vectors do not optimize specific capabilities. 
This experiment assumes that the LCS will be armed with weapons limited to line of 
sight ranges. LCS is not expected to be armed with Over-The-Horizon Targeting (OTH- 
T) weapons like the PEGASUS class PHM.28 29 OTH-T weapons require larger ships 





28 Sandra I Erwin, “Littoral Combat Ship Moving Closer to Reality,” National Defense Magazine, 
April 2003. Available from the World Wide Web @ 
http://www.nationaldefensemagazine.org/article.cfm?Id=1079. Accessed 20 August 2003. 


29 Norman Polmar, The Naval Institute Guide to the Ships and Aircraft of the U.S. Fleet (Annapolis, 
MD: Naval Institute Press, 1993) 197. 
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and will raise the cost of LCS for the weapon system, and also the requirement of 
capabilities to effectively use the weapons. Another assumption made in this thesis is 
that sea-based UCAV capabilities will be available shortly after the LCS enters the 


fleet.30 


This study assumes that the LCS will have some sort of tactical data link. The 
tactical data link might not allow LCS to target and shoot beyond the horizon, but it 
allows the LCS to know the battlespace situation for quick and appropriate response. 
Although some newer tactical data links allow ships to cooperatively engage the enemy 
with other ships’ fire control data as their own, most of the ships in the fleet do not have 
tactical data links with that capability. CRUDES are modeled in EINSTein to operate the 
same. Of course, DDGs, FFGs and CGs differ from each other. Each class of ships has 
specific weapon systems (and numbers of weapon systems), radar systems, fire control 
systems, and operating speeds. In fact, even CGs within the same class differ from each 
other. TICONDEROGA class CGs built before USS BUNKER HILL (CG 52) are 
equipped with the MK 26 guided missile launcher system, while BUNKER HILL and 
later TICONDEROGA class CGs have the MK 41 vertical launch system increasing 
missile capacity and missile launching speed.3! For our purposes, we assume that these 
ships are qualitatively similar with respect to the capabilities of LCS, amphibious ships 
and enemy high-speed boats. 

2. Factors 

Along with the baseline LCS, the Navy is looking at four options to improve LCS 
combat performance. Those options are helo/UCAVs, stealth technology, high volume 
close-in firepower, and 50+ knot sprint capability. This study will model these capability 
factors in the anti-access scenario and explore possible interactions between the factors. 
Also, this study will examine these factors’ effects in a diverse set of ESG ship 


combinations. 


30 Cynthia Curiel, “Northrop Grumman Given Approval to Design, Build X-47B Navy UCAV 
Demonstrators; Award Strengthens UAV Partnership with Defense Department,” Northrop Grumman 
Press Release, May 2003. Available from the World Wide Web @ 
http://www.capitol.northgrum.com/contracts/ngcontr050103b.html. Accessed 27 August 2003. 





31 Norman Polmar, The Naval Institute Guide to the Ships and Aircraft of the U.S. Fleet (Annapolis, 
MD: Naval Institute Press, 1993) 105-6, 125-6, 143. 
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Ul. EXPERIMENTAL DESIGN 


A. INTRODUCTION 

This chapter covers the Littoral Combat Ship (LCS) design factors, the 
experimental design, and data farming. The LCS design factors section discusses the 
four options (potential LCS capabilities) explored in this study and how they are modeled 
in EINSTein. The experimental design section explains the mathematical process used to 
ensure all combinations of the factors are simulated, as well as all of the possible 
Expeditionary Strike Group (ESG) ship configurations incorporating LCS. Data farming 
techniques and some Measures of Effectiveness (MOEs) are discussed in the data 
farming section. 
B. FACTORS 

To obtain insights about what features may improve LCS’s performance, this 
study explores four Littoral Combat Ship design factors: helicopters/Unmanned Combat 
Aerial Vehicles (helo/UCAVs), stealth technology (stealth), high volume close-in 
firepower (firepower), and 50+ knot sprint capability (speed). The baseline LCS (for 
reference), modified LCS, and Helicopter/UCAV capabilities, as modeled in EINSTein, 
are listed below in Table 5. The changes to the LCS capabilities are in bold. 


Movement per : Sensor/Fire S S Phit 
j Staying Power 
time step range (no. engage) 
LCS 
stealth 


LCS 
firepower 


LCS 
speed 
Helo/UCAV 





Table 5 LCS, Modified LCS, and Helo/UCAV Capabilities 


1. Helicopters and Unmanned Combat Aerial Vehicles 
This study considers helicopters and UCAVs to be the same type of entity in the 


model, similar to our grouping of CGs, DDGs, and FFGs as CRUDES ships. Helos and 
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UCAVs fly at approximately the same speed and carry similar weapons, such as hellfire 
missiles.32 33 Helos and UCAVs do differ in flight characteristics and operation; 
however, these differences are relatively small (like the differences between CRUDES 


ships), justifying the abstraction of placing helos and UCAVs in the same category. 


As explained above in Chapter II, section A-3, paragraph 3, Helo/UCAVs exist as 
a squad of agents in this model. They emulate the variability of a pilots’ decision-making 
process and the possibility that a helo/UCAV can be shot down. When the helo/UCAV 
factor is enabled for a run-set, all controlling ships (CRUDES and LCS) have 
helo/UCAVs. The number of helo/UCAVs for that run-set equals the sum of CRUDES 
ships and LCSs. This does disregard scenarios in which CRUDES ships have helos and 
LCSs do not, but these situations can be considered as times when the CRUDES ships’ 


helos are in a no-fly status. 


When undamaged, helo/UCAVs fly up to four squares per time-step 
(approximately 100 knots).34 35 When damaged, their speed drops to up to two squares 
per time-step (approximately fifty knots) to simulate degraded engines, hydraulics 
problems, or an injured pilot. Because the helo/UCAVs are fighting high-speed small 
boats with negligible anti-air capability, undamaged helo/UCAVs can absorb three direct 
hits before becoming damaged. The high-speed small boats are limited to visual air 
searches and would only have small arms weapons and RPGs (Rocket Propelled 
Grenades) available to shoot down aircraft. Damaged helo/UCAVs’ lack of 
maneuverability and smoke make them easier to target, thus only one direct hit is 


required to destroy a damaged helo/UCAV.36 Thanks to their altitude and radar systems, 


32 Public Affairs Office, U.S. Air Force Fact Sheet: RO-1 Predator Unmanned Aerial Vehicle 
(Langley AFB, VA: Air Combat Command, May 2002). Available on the World Wide Web @ 
http://www.af.mil/news/factsheets/RQ_1 Predator Unmanned _Aerial.html. Accessed 29 July 2003. 


33 Norman Polmar, The Naval Institute Guide to the Ships and Aircraft of the U.S. Fleet (Annapolis, 
MD: Naval Institute Press, 1993) 441. 





34 Dennis Sorensen, Naval Unmanned Aerial Vehicles, (Patuxent River, MD: Navy Unmanned Aerial 
Vehicles- PMA263, September 2003). Available on the World Wide Web @ 
http://uav.navair.navy.mil/vtuav/default.htm. Accessed 5 September 2003. 





35 Norman Polmar, The Naval Institute Guide to the Ships and Aircraft of the U.S. Fleet (Annapolis, 
MD: Naval Institute Press, 1993) 441. 


36 Peene- Werft GmbH, Naval Shipbuilding: Fast Patrol Boat FPB 354, (Stralsund, Germany: Peene- 
Werft GmbH, September 2003). Available on the World Wide Web @ _http://www.peene- 
werft.de/en/schiffe/d_fpb354.html#top. Accessed 16 September 2003. 
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undamaged helo/UCAVs have a sensor range of thirty NM (squares). However, damaged 
helo/UCAVs are reduced to using the crew’s vision or degraded sensors at altitude, which 
limits their sensor range to ttn NM. Undamaged helo/UCAVs have access to weapons, 
such as Penguin missiles, Hellfire missiles, and small arms, allowing them to shoot one 
target at up to ten NM away with a ten percent probability of hit. Damaged helo/UCAVs 
have damaged fire control systems and an injured crew, so they can shoot one target 
seven NM away with only a five percent probability of hitting. 

2 Stealth Technology 

Stealth technology makes LCS more difficult to target. From this difficulty, 
stealth also makes LCS harder to hit, damage and destroy. To account for stealth in 
EINSTein, a stealthy LCS has better staying power than a baseline LCS. The staying 
power of an undamaged stealthy LCS is set at three hits, compared to one hit for an 
undamaged baseline LCS, before it becomes damaged. A damaged, stealthy LCS’s 
staying power improves to two hits before it is destroyed. Damaged baseline LCSs are 
destroyed after only receiving one hit. The change to staying power was made because it 
directly affects LCS’s survivability. EINSTein does not allow for changing a platform’s 
probability to hit a specific platform. Altering the probability of hit for the enemy high- 
speed boats would affect their ability to also hit CRUDES and amphibious ships, which is 
not the intention of the LCS stealth improvement. LCS’s staying power was adjusted 
because it isolates the enemy high-speed boats’ ability to damage and destroy a stealthier 
LCS. 

3. Close-In High Volume Firepower 

Close-in high volume firepower (firepower) gives LCS the capability to develop 
fire control solutions on multiple targets at shorter ranges with greater lethality. 
Firepower’s benefits are that it increases the number of contacts LCS can target and 
engage, and it increases the LCS’s probability to hit the targets. Firepower shortens the 
range LCS can shoot. The shorter range might require LCS to enter an enemy platform’s 
weapons range before LCS is able to shoot the platform, creating a situation where LCS 
can be damaged before it ever takes a shot. However, the expectation is that because of 
the enemy’s low probability of hit, LCS will engage and destroy more enemies with the 


firepower factor. 
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In EINSTein, the firepower factor shortens the undamaged and damaged shooting 
ranges to seven NM and five NM, respectively. However, the firepower factor increases 
an undamaged LCS’s maximum number of targets that it can engage to four, with a 
twenty percent probability of hitting. Firepower allows a damaged LCS to engage two 
targets with a ten percent probability of hitting. 

4. Speed, the 50+ Knot Sprint Capability 

The speed factor increases LCS’s undamaged speed to two squares per time-step 
(approximately fifty knots), simulating the 50+ knot capability. A damaged LCS, like a 
damaged baseline LCS, transits at twenty-five knots (one square per time-step). Speed is 
not modeled to affect a platform’s survivability (direct hits required to degrade the 
platform from one state to another). The cruise missile’s speed justifies this assumption. 
The harpoon missile, which travels at a speed of .85 mach (approximately 562 knots), 
would fly over twenty two NM (squares) in the period of one time-step.37 Given its 
speed, a harpoon missile would not have significantly more difficulty attacking a ship 
that travels one more NM per time-step than its normal target that transits at twenty five 
knots. The speed factor is expected to give LCS the ability to engage enemy forces 
further away from the ESG’s amphibious ships. 

C. EXPERIMENTAL DESIGN 

Each factor can have its own effects, beneficial and detrimental, on LCS’s ability 
to defend ESGs. Factors that are enabled simultaneously give LCSs the effects of all the 
enabled factors and the enabled factors’ interactions. The interactions provide effects 
that could not be explored unless the factors that bring it out are enabled both separately 
and simultaneously. For example, stealth coupled with firepower could give LCS the 
survivability to consistently close the enemy to take advantage of the increased 


firepower, therefore improving ESG defense. 


This study took an organized approach to design the experiment so that all factors 
and their interactions could be examined. Table 6 displays the design of experiment. 
Using binary addition, four factors create sixteen different combinations to examine in 


this study, from r0, which has no factors enabled, to rl15 which has all the factors enabled. 


37 Norman Polmar, The Naval Institute Guide to the Ships and Aircraft of the U.S. Fleet (Annapolis, 
MD: Naval Institute Press, 1993) 484-5. 
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The left most column lists the factors being used (helo’s stands for helo/UCAV). A 
factor is used in a particular run-set if there is a “1” in its row below the run-set name. A 
“0” in the factor’s row below a run-set’s name signifies that the factor will not be enabled 


for the run-set. 


run-sets 


ea seen ee ee Oe NOt ee eee 
factors [rO_| r1 | r2| r3 | r4 | r5 | r6 | 7 | r8 | r9 [10] r44| 12/113] 14] 115) 
helo's_—|_ Of 1] of 4f of 4] of 4f of 1] of 4] of 4] of 74 


stealth | Of o| 1| 4] of of 14] 4] of of] 4] 4] Of of 4] 74 
firepower] O| Oo] o| of 1] 4{ 1] 4{ Oo} of of of 4] 4] 4] 14 
speed | Of of of of of of of of 4] af 4] 4] 4] tf 4 4 


Table 6 Design of Experiment 





The sixteen run sets (r0-r15) allow us to methodically explore how the factors and 
interactions affect a disposition of ships. Run-set r0 has no additional capabilities, thus 
using the baseline LCS. Run-set rl includes helo/UCAVs in ESG defense. The r2 run- 
set uses stealthier LCSs. Helo/UCAVs combine with stealthy LCSs to defend the ESG in 
r3. Run-set r4 uses the firepower factor. Run-set r5 uses helo/UCAVs and close-in high 
volume firepower. Stealthy LCSs with firepower are used in the r6 run-set. Run-set 17 
enables the helo/UCAV, stealth and firepower factors. The high-speed LCS is used for 
ESG defense in run-set r8. Speed and helo/UCAYV factors are enabled in r9. Run-set r10 
uses stealthy, speedy LCSs in ESG defense. R11 employs helo/UCAYV, stealth and speed 
factors. Speedy LCSs with firepower are utilized in r12. Run-set r13 incorporates speed, 
firepower and helo/UCAVs. R14 utilizes stealthy, speedy LCSs with increased 
firepower. All four factors are enabled in run-set r15. 

1. Ship Dispositions 

The normal force structure mixture of an ESG is three amphibious ships and three 
CRUDES ships. This was the baseline ship disposition for this study. From the baseline, 
CRUDES ships were removed and LCSs added to the ESG for additional force structure 
mixtures to examine. The top two rows of Table 7 display the various alternative ship 
combinations that were added to the three amphibious ships to create an ESG for this 
study. No CRUDES ships were added to the baseline ESG because an extra CRUDES 


ship would add cost and manpower requirements greater than the baseline, not following 
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the goal of reducing the manpower and dollar costs of an ESG. No LCSs were added to 
the three CRUDES disposition because manpower and dollar costs would also be greater 


than what the baseline requires. 





run 


Table 7 Ship Disposition and Run-Set Plan 


This thesis makes some hypotheses about possible force structure mixtures. 
Specifically, they are that with two CRUDES ships, one CRUDES ship and zero 
CRUDES ships, the optimal amount of LCSs to add to minimize ESG losses will be 
somewhere between one and five, one and seven, and one and seven, respectively. This 
study assumes that the “knee in the curve” (the place where additional forces do not add 


reduced benefit per force unit) for ship losses will be found in these ship dispositions. 


The sixteen run sets for each disposition of ships are shown in Table 7. An “x” 
indicates that factors for the row’s run-set are examined with the column’s ship 
combination. The ship disposition of one CRUDES ship and four LCSs protecting three 
amphibious ships requires examination of all sixteen run-sets. However, the ship 
disposition with three CRUDES and zero LCS protecting the ESG only requires run sets 
r0 and rl because the ship disposition includes no LCSs. Therefore, performing the other 
run sets that include LCS factors would not aid this analysis. Run-sets with the 


helo/UCAV factor enabled use an additional squad of helo/UCAVs. The amount of 
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helo/UCAVs for a particular ship combination equals the sum of CRUDES ships and 
LCSs. So, for example, an ESG with two CRUDES and three LCSs will have a squad of 
five helo/UCAVs flying in run-set rl. 
D. DATA FARMING 

Data farming is a concern for simulation studies. EINSTein allows users to 
retrieve survival data and statistics for the agents in individual runs. In addition, visually 
undamaged platforms maintain the original red or blue, and damaged platforms can be 
switched to change to a light red or light blue to show their change in status. Destroyed 
platforms are not shown unless the user toggles the “Display where red/blue agents were 
killed” setting. However, this study did not require showing destroyed platforms for 
measurements. Also, users can highlight specific squads, but there is no coloration 


difference in the members of a highlighted squad. 


Unfortunately, finding damaged units by squad requires manual data collection. 
Specifically, at the end of a discrete run, an EINSTein user has to highlight a specific 
squad and take note of how many damaged (lighter colored) platforms are left in the blue 
force (not in the highlighted squad). Then, that number is subtracted from the total 
damaged for the blue forces (which is listed at the bottom of the simulation window) to 
calculate the number of damaged platforms in the highlighted squad. Finally, the number 
of damaged platforms in the highlighted squad is subtracted from the number of 
highlighted squad members to calculate the number of undamaged squad members. 
From that information a user knows how many undamaged and damaged platforms are in 
the highlighted squad and can enter that information into the database. This thesis used 
Microsoft Excel spreadsheets for storing the data. The total number of surviving 
platforms in a squad equals the sum of the number of undamaged platforms in the squad 
plus the number of damaged platforms in the same squad. 

1. Measures of Effectiveness 

Measures of Effectiveness (MOEs) are ways to quantify the goals of this study. 
This study’s goal is to find a force structure mix in concert with LCS capabilities that 
protect an ESG in an anti-access scenario so that the amphibious ships can perform 


amphibious operations at the objective. To quantify this goal, we create MOEs of 
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amphibious ship survivors and amphibious ships damaged. Other MOEs relate to 


CRUDES survival, LCS survival, and helo/UCAV survival. The reasons for developing 


other MOEs include that the amphibious ships will need some protection once they arrive 
at the objective and establish the sea base for forces ashore and the navy does not want to 
spend money on a platform and place it in a position to be destroyed. 

2; Initial Data Farming Issues 

Now that the potential MOEs have been established, this study looks at what data 
output can be recovered (farmed) from EINSTein. EINSTein has a quick “Multiple 
Time-Series (Averages/Distributions)” run mode that can perform 100 runs of our 
scenario in less than two minutes. However, the mode does not break down the 
survivability data into specific squads and combines injured and killed into one casualty 
category. EINSTein was originally created for ground combat, and it is understood that 
injured and killed soldiers would be grouped as causalities for a ground commander. A 
damaged ship can still operate to some degree and effectively draw fire away from high 
value units, making it different from an injured soldier. EINSTein’s “Interactive Time- 
Series (Default)” run mode allows users to perform discrete runs. Damaged platforms 
and specific squads can be highlighted, enabling a user to farm run data in the process 
mentioned in the first paragraph of the Data Farming section. However, this is a slow 
and tedious process, with a 50 run run-set taking between 10 and 30 minutes, depending 
on the number of squads and the variability of the data. One advantage of this approach 
is that the analyst visually assesses each run—thus gaining insights on the dynamics 


behind the numbers. 


This study uses four input measures: starting number of amphibious ships, starting 
number of CRUDES ships, starting number of LCSs, and starting number of 
helo/UCAVs. At the end of the runs, output data is placed in up to eight categories on a 


Microsoft Excel spreadsheet: 
Number of undamaged amphibious ships at the end of a run 
Number of damaged amphibious ships 


Number of undamaged CRUDES ships 
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Number of damaged CRUDES ships 
Number of undamaged LCSs 
Number of damaged LCSs 


Number of undamaged helo/UCAVs 








Number of damaged helo/UCAVs 


Averages, minimums, maximums, and standard deviations can be created from 
and for these measures. 

3. Number of Required Runs 

This study used “Multiple Time-Series (Averages/Distributions)” run mode with 
the baseline inputs (3 amphibious ships, 3 CRUDES ships, run-set r0) to try to find the 
minimum required number of runs to perform to have data that encompasses most of the 
possibilities. Run-sets of 50, 100, 150 and 200 runs were performed. The standard 
deviations of the attrition data, shown in Table 8, show that there is little change in the 
estimate of the standard deviation of the casualty data (injured + killed) gained from 
doing more than 50 runs. Therefore, each run-set consists of 50 discrete runs. The 50 
replications results in an estimated standard deviation on the mean number of blue ships 
attrited, our primary MOE, of 1.8455/\(50)=0.26. 50 replications of 16 run-sets 
examining 19 ship combinations equates to 15,200 runs with LCS. An additional 100 
runs are required to get the baseline and 3 CRUDES ship rl run-sets. 


Number of Baseline Runs 


Blue attrition stdev} 1.8455 1.7511 1.7616 1.7651 
Red attrition stdev 4.457 4.3531 3.9715 3.6374 





Table 8 Baseline Runs’ Attrition Estimated Standard Deviations as a Function of 
the Number of Replications 
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IV. DATA AND ANALYSIS 


A. INTRODUCTION 

This chapter discusses the output data and the analysis. The data section talks 
about the observations, and discusses a slight personality adjustment to LCSs (Littoral 
Combat ships) and helo/UCAVs (Helicopters/Unmanned Combat Aerial Vehicles). The 
analysis section reviews the MOEs (Measures Of Effectiveness), and the three data 
groups. The analysis section also discusses analysis techniques, results, and graphical 
methods. Finally, the key findings section focuses on the results that are significant 
across the board and identifies the ship force mixtures and capabilities that perform the 
best. 
B. DATA 

1. Spreadsheet 

This thesis uses a Microsoft Excel spreadsheet to store data and perform 
computations. Each spreadsheet is formatted like Table 9, which is the spreadsheet 
displaying the baseline (three CRUDES ships defending three amphibious ships, no 
factors enabled) run-set data. The initial numbers of amphibious ships, CRUDES ships, 
LCSs and helo (helo/UCAVs) are shown at the top. The spreadsheet is then divided into 
(from left to right) a reference column explaining what information is displayed in the 
row of the reference; alive (undamaged) amphibious ships’ column; injured (damaged) 
amphibious ships’ column; total surviving (undamaged + damaged) amphibious ships’ 
column; alive (undamaged) CRUDES ships’ column; injured (damaged) CRUDES ships’ 
column; total surviving (undamaged + damaged) CRUDES ships’ column; alive 
(undamaged) LCSs’ column; injured (damaged) LCSs’ column; total surviving 
(undamaged + damaged) LCSs’ column; alive (undamaged) helo/UCAVs’ column; 
injured (damaged) helo/UCAVs’ column; and total surviving (undamaged + damaged) 
helo/UCAVs’ column. The exception to this is the sample mean (xbar), calculated for the 
number of injured platforms associated with that column, and the average, calculated for 


the total number of lost (destroyed) platforms associated with the particular column. 
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Starting Values for the Run-set 
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crudes 
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Below the starting values are the initial statistics, these where calculated from the 
data below (in the same column). From top to bottom, the minimum value, average, 
maximum value, sample standard deviation (sig), and estimated standard deviation of the 
population average (sigxb) are calculated and displayed. Next is the losses section, 
where the average number of injured platforms and lost platforms are calculated and 
displayed. The average number of platforms injured, in the particular column, is taken 
from above value in average number of injured platforms. The average number of 
platforms lost, in the particular column, is calculated by subtracting the average number 


of total surviving platforms from the starting number of the platform for the run-set. 


The final section is the data collection section. A run-set consists of 50 discrete 
runs of the simulation with the particular input values, ship disposition and factors (rX). 
At the end of each discrete run the number of undamaged and damaged platforms are 
entered in the row of the run’s sequential number. For example, after the thirteenth run, 
data is entered in the same row as the “13” under the “run” column. The total number of 
surviving platforms is calculated by taking the sum of the number of undamaged 
platforms and the damaged platforms—i.e. summing the two cells to the left. The rest of 
these spreadsheets are displayed in Appendix A (Data). 

2. Mini Analysis 

Looking at the raw data and statistical calculations, one can take note of outliers 
and trends. Also, rough comparisons can be gleaned from the data. Helo/UCAVs seem 
to have a significant impact on ship survival, often improving average ship survival by 
two ships or more. However, helo/UCAVs also take massive losses. In the best cases 
helo/UCAV losses drop below 50%. This is because they perform very aggressively, 
rushing headlong into battle with enemy ships. The aim of this thesis is improving the 
survivability of ESG (Expeditionary Strike Group) ships, however. Helo/UCAVs are 
supporting elements in this endeavor, meant to help increase ship survivability. LCS 
speed appears to be detrimental to ship survival, yet speed slightly benefits helo/UCAV 
survival. Also, LCSs with stealth and firepower appears formidable. 

2: Slight Change in Personality 

It was noticed during initial runs that helo/UCAVs did not completely act as 
desired. LCS and helo/UCAV personalities were originally set as shown in Table 10, and 
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were used for the ship configurations of two CRUDES ships and one through three LCSs. 
In approximately one-fifth of the trials with helo/UCAV factors set, it was noticed that 
when undamaged helo/UCAVs engage enemy ships, they would leave combat to pursue 
the objective (enemy flag), placing the rest of the ESG in a vulnerable position. This 
characteristic of the helo/UCAV reduced their contributions to providing locating 
information on and attriting the threat. The platforms’ desire to engage undamaged 
(alive) enemies had equal weight with their desire to approach the objective. To counter 
this, LCS and helo/UCAV personality vectors were altered, as shown in Table 4, to 
increase the motivation to engage enemy ships over pursuing the objective. These new 


vectors were used for the rest of the simulation runs. 





Anti-Access Personalities 


Amphibs 


CRUDES 
Helo/UCAV 





Table 10 Blue ESG Force Anti-Access Personalities (2 CRUDES, 1-3 LCS) 


C. ANALYSIS 

Initially, for this study the primary MOE was the average total number of ships 
that survive. However, if more ships are added, the number of ships that survive could 
conceivably also increase and the “knee” of the curve (the point where the benefits of 
additional ships lessens) with reference to numbers would not be visible. Conceivably, 2 
CRUDES + 2 LCS-r0 (for a total of 7 ships, including the amphibious ships) could have 
an average of 4 ships surviving while 2 CRUDES + 3 LCS-r0 (for a total of 8 ships) 
could have an average of 5 ships surviving. The 2 CRUDES + 3 LCS-r0 looks better 
than the 2 CRUDES + 2 LCS-r0 based on this MOE, however they both lose 3 ships. 
Therefore, adding one LCS to 2 CRUDES + 2 LCS-r0 adds no benefit to ship 


survivability, yet it is not easily visible using average total surviving ships as the MOE. 
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In order to deal with attrition properly, this thesis uses the average number of 
ships lost as the primary MOE. This MOE does not give undue advantage to the ESGs 
with greater numbers of ships. Looking at the example in the previous paragraph, the 
average number of ships lost MOE would show that adding one LCS to 2 CRUDES + 2 
LCS-r0 does not reduce the number of ships lost. Therefore, adding a LCS to 2 
CRUDES + 2 LCS-r0 would waste an asset and its cost, and the “knee” of the curve in 
this scenario may lie at the 2 CRUDES + 2 LCS-r0 level, or less, for any 2 CRUDES-r0 
case. If the average number of ships that survive is the same for 2 CRUDES + 2 LCS-r0 
and 2 CRUDES + 3 LCS-r0, then the average number of ships lost will be greater for 2 
CRUDES + 3 LCS-r0. Again, signifying no added benefit of adding 1 LCS. However, if 
the total number of ships lost for 2 CRUDES + 3 LCS-r0 is less than the total number of 
ships to 2 CRUDES + 2 LCS-r0, then the added LCS does improve survivability. The 
added LCS survives and helps some of the ships that are destroyed in the 2 CRUDES + 2 
LCS-r0 run-set survive. The total number of ships lost is calculated by taking the sum of 
average number of amphibious ships lost, average number of CRUDES ships lost, and 
average number of LCSs lost. 

1. Data Organization 

This study organizes the data into four distinct groups based on the number of 
CRUDES ships involved. The groups are 3 CRUDES, 2 CRUDES, 1 CRUDES and 0 
CRUDES. Each is distinct from the others, and has enough similarities within the group 
to enable analysis and establishing the number of LCSs as a design factor. Each group 
would utilize different tactics due to the number of CRUDES ships in the ESG. Also, 
“knees” in curves comparing average total ships lost against number of LCSs are visible 
in graphical comparisons. Conceivably, the “knee” of the curves could exist at 
approximately the same number of LCS added to the CRUDES. Therefore, there is a 
possibility to find a sufficient amount of LCSs to add to the CRUDES ships in the set that 
reaches the point that minimizes ship losses per LCS added. Another benefit of 
organizing the data into these groups is that force planners have options on the number of 


CRUDES ships to assign to an ESG. 
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a. 3 CRUDES 

The 3 CRUDES set of data has no LCSs and consists of 2 run-sets: the 
baseline and rl (three CRUDES ships controlling three helo/UCAVs). The data is 
summarized in Table 11. The CRUDES column shows the number of CRUDES 
examined, and the LCS column displays the number of LCS examined. The Run-Set 
column displays the particular run-set examined, and the Helo, Stealth, Firepower and 
Speed columns show if the factor is enabled in the run-set. The Total Ship Loss column 
displays the average total ship loss for the ship disposition shown on the row coupled 
with the run-set factors over 50 runs. The 3 CRUDES set makes no change from what is 
currently out in the fleet. Analysis shows that employing helo/UCAVs for ship defense is 


highly beneficial in this scenario—at least as modeled in this thesis. 


CRUDES Total Ship Loss 
ieee 5 





Table 11 3 CRUDES Data Prepared for Analysis 


There are many comparison methods that can be used to analyze the 3 
CRUDES set’s data. However, because both run-sets comprise large sample populations 
(50 observations), both run-sets are independent of each other, and each run-set has its 
own population mean and variance (standard deviation squared), this thesis uses a large- 
sample comparison test to analyze the 3 CRUDES set’s data.38 The Central Limit 
Theorem states that if there is a set of independent identically distributed random samples 
from a population and the sample set is sufficiently large, the sample mean will be 
approximately distributed as a normal distribution with a mean of the true mean and 
standard deviation equal to the true standard deviation divided by the square root of the 
number of samples in the set. Except in rare circumstances, if a sample set contains more 
than thirty observations the Central Limit Theorem can be used.39 Therefore, the Central 
Limit Theorem is applied to all the data in this thesis, and analysis techniques that require 


data with a normal distribution, like the large-sample comparison test, are utilized. 





38 Jay L. Devore, Probability and Statistics for Engineering and the Sciences: Fifth Edition (Pacific 
Grove, CA: Duxbury, 2000) 360. 


39 Jay L. Devore, Probability and Statistics for Engineering and the Sciences: Fifth Edition (Pacific 
Grove, CA: Duxbury, 2000) 235-6. 
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The average ship loss for the baseline is 3.76 and the average ship loss for 
the 3 CRUDES-r1 run-set is 0.58. Using the large-sample comparison test, the null 
hypothesis, Ho, is that the baseline’s average ship loss is statistically equal to the 3 
CRUDES-r1 run-set’s average ship loss. The alternate, H,, is that the baseline’s average 
ship loss is statistically greater than the 3 CRUDES-r1 run-set’s average ship loss. Table 
12 shows the comparison test and results. The comparison test uses the average ship 
losses, the sample standard deviations of ship loss, over the two samples, each of 50 runs, 


to calculate z in Equation 1. 


Large-Sample Comparison Test 
Avg Ship Loss 0.58 


z= 10.87991614 
| Pvalue | 


Table 12 Large-Sample Comparison Test on the 3 CRUDES Data 





_ r0_avg_ship_loss—r\_avg_ ship _loss 


\° _ stdev’ " rl_stdev’ 
50 50 
Equation 1 §_Large-Sample Comparison Test Formula to Calculate z 





Z 








The P-Value is the probability that we would observe data as extreme, or 
more extreme, than what occurred if the two population means are identical. The P-value 
is calculate by 1-®(z), where ®(z) is the cumulative distribution function of a standard 
normal distribution evaluated at z. The P-value is essentially 0 for this case. Therefore, 
because the probability of achieving these observations, if the null hypothesis is true, is 
so close to zero, this result cannot be considered to be merely the result of chance. 
Consequently, we conclude that air assets matter. However, no helo/UCAVs survived 
any of the 3 CRUDES-rl runs. Therefore, at risk to themselves, they engaged and 
attrited the threat sufficiently so that the CRUDES ships successfully engaged the 


Al 


remainder. In addition, by being out front, the air assets served as scouting platforms, 
providing situational awareness to the ships of the ESG.40 

b. 2 CRUDES 

The 2 CRUDES set has fewer organic land attack missiles and organic 
naval fire support systems than the baseline for amphibious operations. However, its 
command and control capabilities are greater than those of an ESG with zero or one 
CRUDES ship. The 2 CRUDES ESGs also have LCS. The 2 CRUDES data group is 
displayed in Appendix B (Data Groups for Analysis). A graph of average total ship loss 
vs. number of LCS, for each run-set, is shown in Figure 3. With the exception of the 
baseline, r4 (firepower), r8 (speed), and r12 (firepower and speed) LCS configurations, 
adding LCSs to the 2 CRUDES ESGs yields fewer losses. Note, the points in the graph 
are estimates. The standard deviation of each is estimated as the run-set’s sample 
standard deviation divided by the square root of the sample size. The sample standard 


deviation is usually around 1.5 and the sample size is always 50. Thus, the random 
points have associated standard deviations of about 1.5/ 50, which equals .21. For 


cases with fewer losses, the sample standard deviations are usually much smaller than 


1.5. 


40 Wayne P. Hughes, Fleet Tactics and Coastal Combat (Annapolis, MD: U.S. Naval Institute, 2000) 
92-3. 
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Figure 3 2 CRUDES + X LCS, Ship Loss vs. Number of LCS 
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Taking a look at the main factors (baseline, helo/UCAV, stealth, 
firepower, and speed) by themselves, in Figure 4, helo/UCAYV (rl) and stealth (12) ship 
losses diminish as LCSs are added. However, when LCSs are added to the baseline (r0), 
and speed (r8) cases, they merely add to ship losses. The firepower (r4) case does not 
appear to change force performance, seemingly almost flat and indicating that 1 LCS 
might be the “knee” of that particular line. The total ship loss for 2 CRUDES + 2 LCS is 
higher than 2 CRUDES + 1 LCS. This is consistent with the 1 and 0 CRUDES sets of 
data using that run-set. These graphs provide good preliminary analysis and ANOVA 
(ANalysis Of VAriance) will provide further detailed review. The body of this study 
displays graphs of note, but all may be found in Appendix D (Graphs). 
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Figure4 2CRUDES+ X LCS, Ship Loss vs. Number of LCS, Main Factors Only 


ANOVA was performed, individually, on the 2-, 1-, and 0- CRUDES sets. 
ANOVA is a collection of statistical procedures for the analysis of quantitative responses 
from experimental units.4! It is the approach this study is taking in order to discern 
which factors account for significant differences in force performance. The null 
hypothesis is that there is no difference in the average number of ships lost if a factor is 
changed (whether a LCS capability is enabled or not, the number of LCSs assigned to the 
ESG, and combinations of the aforementioned factors). The alternate is that force 
survival does change as a particular factor changes. This approach is taken for each main 


factor and each multiple factor interaction of interest. 


The number of LCSs, whether or not air assets are present, whether or not 
stealth is employed, whether firepower is augmented, and whether high-speed is used, are 
all characteristics that may contribute to differences in ESG effectiveness. The number 


of LCSs characteristic takes the number of LCS assigned to an ESG so the factor could 


41 Jay L. Devore, Probability and Statistics for Engineering and the Sciences: Fifth Edition (Pacific 
Grove, CA: Duxbury, 2000) 402. 
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be one of five or six numbers. The other factors are binary, meaning that they are 1 if 
they are enabled and 0 if not. In zero, one or two CRUDES force dispositions, ANOVA 
will examine average total ship loss as a function of number of LCSs, the helo/UCAV 
factor, stealth, firepower, and/or speed. Interactions among these design considerations 


are also examined. 


The ANOVA of the 2 CRUDES force total ship losses as a function of the 
factors (numbers of LCSs, Helo/UCAV, stealth, firepower, and speed), including up to 
three-way interactions (e.g., number of LCSs * if the stealth factor is enabled * if the 
speed factor is enabled), is shown in Table 13. An interaction occurs when the effect of 
one factor depends on the values of other factors. There are a sufficient amount of 
residuals to use to check the model. Residuals are the sample counterparts of error terms 
and equal the differences between observed and predicted average ship losses. The 
residual mean square error (MSE, which is under the Mean Sq and in line with residuals, 
in the table) measures the variation of estimates around a parameter. A good residual 
MSE should be as low as possible to show that the sample estimates are near the 
observed simulation outputs. However, if there are too few residuals the model will be 


over-fit.42 


An over-fit model may not have much variability in its evaluation, but its 
predictive accuracy will be quite poor. The residual mean square error of this model, 
0.0559, is significantly better (smaller) than the ANOVA model using the same function 
with only two-way interactions (e.g., number of LCSs * if the stealth factor is enabled), 
which has a residual MSE 0.2737. Also, the ANOVA model with three-way interactions 
has a better residual MSE than the ANOVA model using the same function with up to 
four-way interactions, which has a residual MSE of 0.0560. Another test for the 
ANOVA model with three-way interactions is the residual plot. The residual plot in 
Figure 5 shows that the residuals have a normal looking, homoscedastic pattern. This 
means the data fits the model, but not perfectly, as there is randomness. In addition, the 


expectation is that hypothesis tests in the ANOVA are unbiased. 


42 Lawrence C. Hamilton, Regression with Graphics: A Second Course in Applied Statistics (Pacific 
Belmont, CA: Duxbury, 1992) 32, 73. 
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D£ Sum of Sq Mean Sq F Value Pr (F) 











































































































Lcs.f 4 4.0100 1.0025 17.941 0.0000015 

HELO 1 204.6080 204.6080 3661.733 0.0000000 

STEALTH 1 57.0882 57.0882 1021.669 0.0000000 

FIREPOWER 1 12.4031 12.4031 221.970 0.0000000 

SPEED 1 4.4462 4.4462 79.571 0.0000000 

LCS.£:HELO 4 2.5767 0.6442 11.528 0.0000413 

LCS.£:STEALTH 4 5.9270 1.4818 26.518 0.0000001 

LCS.£:FIREPOWER 4 0.9260 0.2315 4.143 0.0125266 

LCS.£:SPEED 4 0.1673 0.0418 0.748 0.5700467 

HELO:STEALTH 1 21.6112 21.6112 386.761 0.0000000 

HELO: FIREPOWER 1 3.2886 3.2886 58.854 0.0000002 

HELO:SPEED 1 0.0000 0.0000 0.001 0.9776283 

STEALTH: FIREPOWER 1 0.3672 0.3672 6.572 0.0181029 

STEALTH:SPEED 1 0.2442 0.2442 4.370 0.0489123 

FIREPOWER:SPEED 1 0.0110 0.0110 0.198 0.6611606 

LCS.£:HELO:STEALTH 4 8.1823 2.0456 36.608 0.0000000 

LCS.£:HELO:FIREPOWER 4 1.2244 0.3061 5.478 0.0035053 

LCS.f£:HELO:SPEED 4 0.0834 0.0208 0.373 0.8251777 

LCS.f£:STEALTH: FIREPOWER 4 0.2971 0.0743 1.329 0.2918246 

LCS.f£:STEALTH:SPEED 4 0.0125 0.0031 0.056 0.9937063 

LCS.f£:FIREPOWER:SPEED 4 0.1582 0.0395 0.708 0.5956583 

HELO: STEALTH: FIREPOWER 1 1.4742 1.4742 26.384 0.0000435 

HELO:STEALTH:SPEED 1 0.5746 0.5746 10.283 0.0042365 

HELO: FIREPOWER: SPEED 1 0.2142 0.2142 3.834 0.0636347 

STEALTH: FIREPOWER: SPEED 1 0.0174 0.0174 0.311 0.5826719 
Residuals 21 1.1734 0.0559 





Table 13. ANOVA of the 2 CRUDES Set’s Total Ship Losses, Including Up to 3- 
Way Interactions 
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Figure 5 _ Residual Plot for the 2 CRUDES ANOVA 


Looking at the ANOVA in Table 13, the Pr(F) column gives the P-value 
for each model term. When it is sufficiently small—on the order of less than 1-in-20 
chance—the factor or interaction is statistically significant. The factors and interactions 
with a significant P-value are in bold print. All the factors (helo/UCAV, stealth, 
firepower, speed and numbers of LCSs) influence ship loss by themselves. The SS (Sum 
of Squares) under the “Sum of Sq” header measures how much variability is explained by 


that factor. The larger the SS, the more influential the factor or interaction is. 


The influence of helo/UCAVs is almost four times greater than the next 
largest, stealth. Presence of aircraft is the single most influential factor when it comes to 
force effectiveness. This study looks at graphical comparisons later to discover if the 
helo/UCAV factor’s influence has a beneficial or detrimental effect on average ship loss. 
Figure 6, comparing r2 (stealth) to r3 (stealth + helo/UCAV), shows that aircraft have a 


beneficial effect on preventing ship loss. Ship loss for r3 bottoms out at 0 at 
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approximately three LCSs or more, and r2 performs consistently worse by two ship 
losses. Other graphs that display similar comparisons isolating the helo/UCAV factor are 
in Appendix D. 
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Figure6 2 CRUDES+ X LCS, Ship Loss vs. Number of LCS, r2 and r3 


The next most influential factor is stealth. Its ability to explain variability 
in the MOE, under SS, is more that two times greater than the next largest contributor, 
the interaction between air assets and stealth. Stealth is also significant, with a very 
beneficial effect on reducing ship losses [Appendix D]. Because the helo/UCAV 
interaction with stealth is the next most influential term, having both aircraft and stealth 
makes an ESG well protected. If all factors cost the same and only two could be chosen, 


then helo/UCAVs and stealth would be the best choices in this scenario. 


Firepower comes in fourth for influence and it has a positive influence. 
The interaction of numbers of LCS, the helo/UCAV factor and the stealth factor is next, 
further highlighting how the helo/UCAV-stealth combination is advantageous to have for 
an ESG in this situation. The results for speed, an influential factor, are mixed. Figure 7, 
the graph comparing rl (helo) and r9 (helo and speed), as well as others, shows speed has 


a potentially detrimental effect. The speed effect shows that not all influential factors 
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have a beneficial effect on average total ship loss. LCSs with the speed factor acted too 
aggressively. They would tend to charge ahead of the CRUDES ships, thus allowing the 
threat to engage the ESG piecemeal. A smart CO (Commanding Officer) would not do 
this. More importantly, if using speed is detrimental to force effectiveness, then this 
tactical capability would be worthless. The other factors in bold are significant, but the 


aforementioned factors provide the most significant influence on average ship loss. 
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Figure 7 2CRUDES+ X LCS, Ship Loss vs. Number of LCS, rl and r9 


Cc. 1 CRUDES 

The 1 CRUDES set only has a single organic land attack missile shooter 
and naval fire support system, for amphibious operations, but has the flexibility to have 
the amphibious aircraft carrier or the CRUDES ship as the strike group command and 
control platform. The 1 CRUDES set also has the benefits of LCS. The summary of the 
1 CRUDES data is displayed in Appendix B (Data Groups for Analysis). A graph of the 
average total ship loss vs. number of LCS, separated by run-set, is shown in Figure 8. 
Like the 2 CRUDES display, the 1 CRUDES display shows, with the exception of 10, r4, 
r8, and r12, that the run-sets improve with additional LCSs. For the main effects in 


Figure 9, helo/UCAV (11) and stealth (r2) losses shrink with each additional LCS. On 


49 


the other hand, the baseline (r0), and speed (r8) cases get worse with more LCS ships. 
The average ship loss for the firepower (r4) case does not seem to change as LCSs are 
added. 
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Figure 8 1 CRUDES + X LCS, Ship Loss vs. Number of LCS 
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Figure9 1 CRUDES+ X LCS, Ship Loss vs. Number of LCS, Main Factors Only 
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The ANOVA of the performance for the 1 CRUDES ESG is summarized 
in 0. Like with the ANOVA model chosen for the 2 CRUDES set, there are sufficient 
residuals to use to check this chosen model. The residual MSE for this model, 0.0724, is 
better (smaller) than the ANOVA model using the same function with only three-way 
interactions, which has a residual MSE 0.1137. The chosen model has only a slightly 
worse residual MSE than the ANOVA model using the same function with up to four- 
way interactions, which has a residual MSE of 0.0648. However, the chosen model is 
better when it comes to allowing for variability (number of residuals). The chosen 
ANOVA model has 21 residuals for comparison to the function while the ANOVA model 
with up to four-way interactions only has 5 residuals. In a step-wise approach, analysis 
shows that the interaction of number of LCSs, the helo/UCAYV factor, stealth, and 
firepower yields a P-value of 0.0108198, showing a significant effect on average ship 
loss. Additionally, the model passes the residual plot check. The residual plot, which is 


displayed in Appendix D, shows a homoscedastic and normal distribution about zero. 






































































































































Df Sum of Sq Mean Sq F Value Pr(F) 
Lcs.f 5 8.3928 1.6786 23.192 0.0000001 
HELO 1 304.0240 304.0240 4200.516 0.0000000 
STEALTH 1 144.3542 144.3542 1994.454 0.0000000 
FIREPOWER 1 33.3233 33.3233 460.407 0.0000000 
SPEED 1 1.6224 1.6224 22.416 0.0001124 
LCS.£:HELO 5 4.9900 0.9980 13.789 0.0000049 
LCS.£:STEALTH 5 4.2129 0.8426 11.641 0.0000177 
LCS.f:FIREPOWER 5 0.6875 0.1375 1.900 0.1372766 
LCS.f£:SPEED 5 0.0265 0.0053 0.073 0.9956677 
HELO:STEALTH 1 48.0534 48.0534 663.925 0.0000000 
HELO: FIREPOWER 1 8.0042 8.0042 110.589 0.0000000 
HELO:SPEED 1 0.2440 0.2440 3.371 0.0805358 
STEALTH: FIREPOWER 1 0.2204 0.2204 3.045 0.0955858 
STEALTH:SPEED 1 0.5104 0.5104 7.052 0.0147939 
FIREPOWER:SPEED 1 0.0054 0.0054 0.075 0.7874095 
LCS.f£:HELO:STEALTH 5 17.9690 3.5938 49.654 0.0000000 
LCS.£:HELO:FIREPOWER 5 2.9450 0.5890 8.138 0.0002114 
.CS.£:HELO:SPEED 5 0.0856 O01 EL 0.237 0.9418963 
LCS.£:STEALTH: FIREPOWER 5 0.7443 0.1489 2.057 0.1117734 
LCS.f£:STEALTH: SPEED 5 0.1950 0.0390 0.539 0.7446132 
LCS.f:FIREPOWER:SPEED 5 0.0881 0.0176 0.244 0.9384032 
HELO: STEALTH: FIREPOWER 1 3.7446 3.7446 51.737 0.0000004 
HELO: STEALTH:SPEED 1 0.2904 0.2904 4.012 0.0582456 
HELO: FIREPOWER:SPEED 1 0.4538 0.4538 6.269 0.0206068 
STEALTH: FIREPOWER: SPEED 1 0.0748 0.0748 1.034 0.3208633 
LCS .£:HELO: STEALTH: FIREPOWER 5 1.4373 0.2875 3.972 0.0108198 

Residuals 21 Le5r9'9 0.0724 


Table 14 ANOVA of the 1 CRUDES Set’s Total Ship Losses, Including Up to 3- 
Way Interactions + # LCSs*helo/UCA V*stealth* firepower 
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Again, the null hypothesis is that a design factor or interaction makes no 
difference on average ship loss. The probability of observing the results in this study, 
were the null hypothesis true, Pr(F), is almost zero for all the main effects and several 
interactions highlighted in bold in Table 14. Next, the explained variance, “Sum of Sq” 
column, provides insight into which factors are more influential (cause variation in the 
response) on force performance. Preasence of helo/UCAVs is more than twice as 
influential than the next largest, which is stealth. Helo/UCAVs remain the most 
influential factor when it comes minimizing ship losses. The plots in Appendix D show 
that the presence of helo/UCAVs leads to lower average ship loss, including displays that 
isolate the helo/UCAV factor. 


As in the 2 CRUDES group, the next most influential single factor is again 
stealth. Stealth’s SS is more than three times greater than the next largest term, 
helo/UCAV’s interaction with stealth. Not only is stealth significant, it has a beneficial 
effect on minimizing ship loss. The fact that helo/UCAVs interaction with stealth is the 
next most influential term shows that having both helo/UCAVs and stealth makes an 
ESG well defended. Again, firepower comes in fourth for influence and it has a positive 
influence. The interaction of number of LCSs, helo/UCAVs, and stealth makes a decent 
showing for influence. These factors provide the most significant influence on force 
performance. 

d. 0 CRUDES 

The 0 CRUDES set has no organic Tomahawk missiles or organic naval 
gunfire systems for amphibious operations. However, a fleet commander has greater 
flexibility in employing CRUDES ships, which includes assigning them on demand to 
launch land attack missiles or provide naval fire support for amphibious operations. The 
amphibious aircraft carrier is the only major strike group command and control platform 
in the ESG. The 0 CRUDES data is displayed in Appendix B (Data Groups for 
Analysis). 


A graph of the average total ship loss vs. number of LCS, separated by 
run-set, is shown in Figure 10. Like the 2 and 1 CRUDES displays, the 0 CRUDES 
display shows, with the exception of r0, r4, r8, and r12, that the run-sets get better with 


each added LCS. Speed and firepower are not good options by themselves. Also, 
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looking at the main effects in Figure 11, helo/UCAV (r1) and stealth (12) diminish losses 
with each additional LCS. On the other hand, the baseline (r0), speed (r8), and now 
firepower (4) cases get worse as LCSs are added. Simply stated, more ships with these 


capabilities are more targets that can be lost. 
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Figure 10 0 CRUDES + X LCS, Ship Loss vs. Number of LCS 
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Figure 11 0 CRUDES + X LCS, Ship Loss vs. Number of LCS, Main Factors Only 


Like the 1 CRUDES set’s ANOVA model, the 0 CRUDES set’s ANOVA 
model of force performance is a function of number of LCSs and the four LCS factors, 
with interactions, in 0. This model has sufficient residuals to check model adequacy. By 
including the four-way interaction, the unexplained variance in this model is 20% of that 
for the model with only three-way interactions. The chosen ANOVA model has a 
slightly worse residual MSE than the ANOVA model using the same function with up to 
four-way interactions, but it has seventeen residuals for comparison, as opposed to the 
model with up to four-way interactions which has only has four residuals. The 
interaction of number of LCSs, the helo/UCAV factor, stealth, and firepower has a P- 
value, Pr(F), close to zero. Again, the residuals comply with the normality and 


homoscedasticity assumptions, as shown in Appendix D. 
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Df Sum of Sq 
Lcs.f 4 6.1828 























































































































HELO 1 291.4661 

STEALTH 1 153.6242 

FIREPOWER 1 40.2996 

SPEED 1 0.0396 

LCS.£:HELO 4 10.3625 
LCS.£:STEALTH 4 4.1066 
LCS.£:FIREPOWER 4 0.3206 
LCS.£:SPEED 4 0.2362 
HELO:STEALTH 1 37.5106 

HELO: FIREPOWER 1 5.1918 
HELO:SPEED 1 0.2856 

STEALTH: FIREPOWER 1 1.1761 
STEALTH:SPEED 1 0.0162 
FIREPOWER:SPEED 1 0.0396 
LCS.£:HELO:STEALTH 4 18.1258 
LCS.£:HELO:FIREPOWER 4 4.3364 
LCS.£:HELO:SPEED 4 0.0322 
LCS.£:STEALTH:FIREPOWER 4 0.3423 
LCS.£:STEALTH:SPEED 4 0.1094 
LCS.£:FIREPOWER:SPEED 4 0.0476 
HELO: STEALTH: FIREPOWER 1 8.0011 
HELO:STEALTH:SPEED 1 OetOQ2 
HELO: FIREPOWER:SPEED 1 0.0530 
STEALTH: FIREPOWER: SPEED 1 0.0361 
LCS .£:HELO: STEALTH : FIREPOWE 4 1.9255 
Residuals 17 0.4543 
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. 0000000 
. 0000000 
. 0000000 
. 0000000 
-2400798 
. 0000000 
. 0000000 
- 0482526 
eLIT1L2523 
.0000000 
. 0000000 
.0045207 
.0000042 
-4462951 
-2400798 
. 0000000 
. 0000000 
- 8729508 
.0393104 
-4234147 
. 7741740 
. 0000000 
-0670954 
.1768911 
-2610174 
.0000061 


Table 15 ANOVA of the 0 CRUDES Set’s Total Ship Losses, Including up to 3- 
Way Interactions + # LCSs*helo/UCA V*stealth* firepower 


All significant factors are in bold in the ANOVA summary table. 


main effects (with the exception of speed), without any interactions, influence ship loss. 
Helo/UCAV capability is almost two times more influential than the next factor, stealth. 
So again, Helo/UCAV is the most influential factor when it comes to ship losses. Figure 
12 compares r4 (firepower) to r5 (helo/UCAV + firepower) and the other graphical 
comparisons in Appendix D show that helo/UCAVs lower the average number of ships 


lost. Graphs that display similar comparisons isolating the helo/UCAV factor are in 


Appendix D. 
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Figure 12 0 CRUDES + X LCS, Ship Loss vs. Number of LCS, r4 and r5 


Again, the next most influential factor is stealth. Stealth is more than 
three times greater than the third largest factor, firepower. Stealth is also very significant, 
and looking at graphical comparisons in Appendix D we see that stealth has a beneficial 
effect on ship loss. Firepower is the third most influential factor on average ship loss and 
it has a positive influence. The helo/UCAV interaction with stealth comes in a close 
fourth and is almost two times greater than the next most influential term, the interaction 
of numbers of LCSs, helo/UCAV, and stealth. These factors provide the most significant 
influence on average ship loss. 

D. KEY FINDINGS 

Across the board helo/UCAV is the most significant factor in reducing ship 
losses, and the baseline, firepower alone, speed alone, and firepower with speed are not 
good options to choose. When LCSs are involved, stealth is also very significant in 
reducing ship losses. Having both air assets and stealth design prove beneficial in 
reducing ship losses. Firepower is influential when designed with helo/UCAVs or 
stealth. Figure 13 shows that r6 (stealth + firepower) performs substantially better than 
12 (stealth). 
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Figure 13 0 CRUDES + X LCS, Ship Loss vs. Number of LCS, r2 and r6 


1: Best Performers of Each Set 

This thesis set a threshold number that a run-set’s average ship loss needs to 
achieve for the particular run-set can be considered as acceptable. Keeping with the 
Chief of Naval Operations statement that LCSs were not going to be expendable, the 
threshold is set so that average losses has to be less than or equal to one ship.43 The only 
run-set that met that requirement in the 3 CRUDES set is 3 CRUDES-rl—.e., with 
helo/UCAVs. The run-sets of the 2 CRUDES set that met this requirement are displayed 
in Figure 14. Figure 15 displays the run-sets in the 1 CRUDES set that met the 
requirement. The run-sets from the 0 CRUDES set that reduced losses to less than one 
ship are shown in Figure 16. Run-sets rl (helo/UCAV), 13 (helo/UCAV + stealth), r5 
(helo/UCAV + firepower), 16 (stealth + firepower), r7 (helo/UCAV, stealth and 
firepower), rl1 (helo/UCAYV, stealth and speed), r13 (helo/UCAV, firepower and speed), 
and r15 (helo/UCAYV, stealth, firepower and speed) beat the threshold at some point (i.e., 


with enough LCSs) for the 2-O CRUDES sets. Run-set r14 (stealth, firepower and speed) 


43 Marty Kauchak, "Navigating Changing Seas: Navy Chief Harbors No Illusions About the 
Challenges that Lie Ahead," Armed Forces Journal International (August 2002): 4. Available on the World 
Wide Web @ http://www.afji.com/AFJI/Mags/2002/August/navigating 4.html. Accessed 24 September 
2003. 
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was one of the best for the 1 and 0 CRUDES sets. Additionally, looking at the graphs, it 
seems no matter the number of CRUDES ships the “knee” of the curve seems to exist 
somewhere between five and seven total platforms protecting the three amphibious ships. 
This means if the ESG has 2 CRUDES ships, a commander should probably add three to 
five LCSs, with the capabilities that make it one of the best, for a well-protected ESG— 
i.e. the sum of CRUDES ships and LCSs should equal between five and seven. 


Using the best performing run-set r7, this study examined force structures of 1 
CRUDES + 1 LCS and 2 LCSs defending ESG and the data is displayed in Appendix A 
(Data). The average ship loss is 1.54 and 0.94, respectively; meaning one of fewer 
protecting platforms could be available after such an engagement. Considering the ESG 
requires defense once it has reached its objective, 1 CRUDES + 1 LCS, 2 LCSs and 1 
LCS would not be an effective defense for ESG in this scenario. This section’s key 


findings lead to other interesting conclusions, discussed in Chapter V. 
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Figure 14 Best of 2 CRUDES + X LCSs 
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Figure 15 Best of | CRUDES + X LCSs 
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Figure 16 Best of 0 CRUDES + X LCS 
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Vv. CONCLUSIONS AND FUTURE STUDIES 


A. INTRODUCTION 

This chapter discusses conclusions, makes recommendations, and talks about 
potential future studies. The conclusions and recommendations section discusses 
conclusions made from the analysis and comes up with recommendations on LCS 
(Littoral Combat Ship) numbers and capabilities to successfully protect ESGs 
(Expeditionary Strike Groups) against a high-density small boat attack. The future 
studies section discusses possible additional studies examining LCS possibilities. 
B. CONCLUSIONS AND RECOMMENDATIONS 

When designing a new class of ship, such as the Littoral Combat Ship, many 
options must be considered. Before metal is bent, decisions must be made about what 
capabilities are required. This study uses the EINSTein simulation to explore the 
potential effectiveness of various force mixes and LCS capabilities to protect an ESG. 
Before summarizing our conclusions and recommendations it is important to emphasize 
that these findings are based on an exploratory analysis with a relatively simple and 
highly abstract model. The numbers, characteristics and tactics of the enemy were fixed. 
Therefore, the results should be viewed as tentative working hypotheses that should be 


tested with other means—perhaps more detailed models. 


This study’s primary finding is that a helo/UCAV (helicopters/Unmanned Combat 
Aerial Vehicle) capability is consistently the most significant factor in reducing ship 
losses in this scenario. All run-sets with the helo/UCAV factor enabled, except for r9 
(helo/UCAV and speed), decreased the average number of ships lost to less than one. 
These findings are consistent with the U.S. Navy’s decision to design the initial block of 


LCS with the capability to employ and support an organic helicopter. 


The combination of both helo/UCAV and stealth factors achieved average ship 
losses for ESG ships below 1.0, given at least four protecting platforms (CRUDES + 
LCS), below 0.5, given at least five protecting platforms, and almost no losses, given 
seven protecting platforms. These outcomes merit strong consideration that LCS should 


probably have both the capability to control a helo/UCAV and a stealthy hull. Designing 
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LCS with a helicopter hangar or UCAV maintenance facilities might offset the effects of 
building a stealthy hull. Equipping LCS with only control capabilities would allow for a 
more compact and stealthier LCS hull form, while reaping the benefits of armed air 
support for maritime missions, if a larger platform, like the amphibious carrier or a 
CRUDES ship, could be charged with the duties of providing logistic support for the 
helo/UCAVs. Such an approach would enable LCS’s weight, space and crew to be used 


for other purposes. 


Close-in high volume firepower does not appear to add as much capability as the 
helo/UCAV and stealth factors. However, combining it with helo/UCAVs or stealth 
lowers average ship losses to below 1. If program officers are forced to choose either 
helo/UCAV or stealth (no combination of the two) designs, this study recommends 


purchasing the helo/UCAV and firepower for LCSs. 


As modeled in this study, and if not used wisely, tactical speed is a potential 
liability to LCS protection of the ESG. In all the cases with a high-speed design, force 
effectiveness is worse than when it is not enabled. Smart Commanding Officers would 
not tend to leave the mutual defense of the ESG, and this study could have used a meta- 
rule to model this behavior. Why introduce speed when it is unwise to use it? When 
LCS operates within the strike group, defending against attackers, enhanced speed is no 
factor due to stationing requirements of remaining in a smaller area and staying with 
slower ships. Also, the other factors would most likely add weight to LCS, increasing the 


cost to have the high-speed ability, so speed is not a recommended capability. 


Although the 0 CRUDES set has good results for ESG defense in this study, 
tactical experience dictates that ship force mixtures should have at least one CRUDES 
ship to defend the force. At least one CRUDES platform enhances ESG air defense 
capabilities, enables greater flexibility in support of amphibious operations, improves 
command and control, contributes land attack capability, and provides naval surface fire 
support. Only in the most permissive tactical scenario does a 0 CRUDES alternative 
make sense, and force planners cannot assume this to be the case. 

C; FUTURE STUDIES 
1. Defending an ESG Sea-Base 
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When ESGs arrive in a theater, they may perform amphibious operations without 
establishing an “iron mountain” ashore. During this sea-to-objective maneuver (STOM), 
the force establishes a sea-base to provide logistical support for forces ashore. To 
maintain a reliable tether and preserve the flow of supplies and support, the force 
maintains station in a limited maneuvering area. This presents a vulnerability in need of 
defense. The same threat used in this thesis is a viable scenario for an ESG providing a 
sea-base, making it a reasonable focus of analysis in EINSTein. A tentative set of 
personalities for such a study is listed in Table 1, see also the scenario described by 
Figure 1. Ship force structures and LCS capabilities can be explored in a similar fashion 


to this study to find beneficial alternatives. 


In Theater Personalities 


Amphibs 


CRUDES 
Helo/UCAV 





Table 16 Blue Agent In Theater Personalities 
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Figure 17 In Theater Battlefield 


2. LCS Modularity 
LCS modularity is another issue that needs to be explored. LCSs are 

perceived to have modularity, meaning that part of the vessel will be able to be switched 
when different missions are required. One module can best suit LCS for defense against 
a surface threat like that explored here. Other modules outfit LCS with ASW (Anti- 
Submarine Warfare), MIW (Mine Warfare), or possibly AW (Air Warfare) capabilities. 
All of these capabilities should be explored in viable scenarios to find what specific 
capabilities would help LCS defend an ESG or CSG (Carrier Strike Group) against 
submarine, mine or air threats. 

3. LCS Acquisition and Deployment in the Fleet 

As with all new combat systems, the acquisition process can be quite lengthy— 
with many milestones. Networks, linear programming and non-linear programming 
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models can help the U.S. Navy acquire LCS in an efficient manner. CPM (Critical Path 
Management) models show tasks that can delay acquisition if these tasks are not 
completed on time. Also, CPM helps create a well-organized schedule. Networks, linear 
programming and non-linear programming models can also help the U.S. Navy deploy 
newly acquired LCSs to where they are needed and arrange deployment schedules so that 
fleet requirements are met while minimizing crew deployment time. 

4. Logistics 

Many agent-based models like EINSTein and its predecessor, ISAAC, focus 
purely on combat. Other agent-based models include logistical aspects that can be 
explored in future studies. Some of these studies could explore the viability of using 
LCSs to protect landing craft providing logistical support for troops ashore. Other studies 
could examine the logistical limits of operating LCS. 
D. CONCLUDING REMARKS 

As discussed, EINSTein is an abstraction of fleet tactical warfare and requires a 
fair amount of discussion to draw the connection between agent activity and shipboard 
operations. Nevertheless, its depiction of the effects of design considerations rings 
plausible for this scenario. A properly designed experimental study accounted for 
individual factors and interactions. It yielded results that enable analytical approaches, 
warfare designs and alternatives to be compared. This research provides a quantitative 
basis for further, higher resolution studies that should consider the measurable benefits of 
air capability and stealth and the relative ineffectiveness of tactical speed for this new 


littoral combatant ship. 


65 


THIS PAGE INTENTIONALLY LEFT BLANK 


66 


APPENDIX A. DATA 


A. INTRODUCTION 

This appendix displays all the raw data observations from the EINSTein 
simulation runs. The data is categorized by the ESG’s ship disposition and particular 
run-set (group of factors) used. The initial numbers of amphibious ships, CRUDES 
ships, LCSs and helo (helo/UCAVs) are shown at the top. The table is then divided into 
(from left to right) a reference column explaining what information is displayed in the 
row of the reference; alive (undamaged) amphibious ships’ column; injured (damaged) 
amphibious ships’ column; total surviving (undamaged + damaged) amphibious ships’ 
column; alive (undamaged) CRUDES ships’ column; injured (damaged) CRUDES ships’ 
column; total surviving (undamaged + damaged) CRUDES ships’ column; alive 
(undamaged) LCSs’ column; injured (damaged) LCSs’ column; total surviving 
(undamaged + damaged) LCSs’ column; alive (undamaged) helo/UCAVs’ column; 
injured (damaged) helo/UCAVs’ column; and total surviving (undamaged + damaged) 
helo/UCAVs’ column. The exception to this is the sample mean (xbar), calculated for the 
number of injured platforms associated with that column, and the average, calculated for 
the total number of lost (destroyed) platforms associated with the particular column. 


B. DATA 
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Starting Values for the Run-set 
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Table 17 Baseline Data Spreadsheet 
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Ps | starting values for the run ea ey ee [es |e 
|_| _amphibs [| crudes | ics | helo | 
a a aa a | |e es Fee 
Sa (OR Rea (cr (Aenea | (Tree) (eee es (ee OE | 
|_| amphib alive | amphib inj | total amphib 
pmin | of of of of of of of fo 
jxbar{ 0.84 | 0.56 | 14 002 4 | 6 OT CT 
peg OS Pe Se Te 2 | | Oe 
| sig | 0.99713876| 0.7329 | 1.34011879 | 0.14142136| 0.404566[0.42185209[ 0 [| o [| oO | 
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—— 4 starting values for the run a ee ee) Fae (ee 
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fe le all se aS te ON he = a = 
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| starting values for the run a 
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|__| amphibs | crudes | Ics [| helo [| 
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a 
helo alive[ helo injured 
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he | starting values for the run YSN _ ZANE 

|_| amphibs | crudes [ics | helo TP 

pe BN esl) 5 = a = SY BO aa TS 
ae 


ae es ere ie oes oe Pte ne ll te i 
|_| amphib alive | amphib inj | total amphib 
Ee a (ER AE AS PR: (RR (| es 
jxbar| 0.9 | 0.66 | 156 | 006 | 012 | 018 | CT 
i ES a) (EE (A (| 
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he | starting values for the run YSN _ ZANE 

|_| amphibs | crudes [ics | helo TP 

(eR (De) (ee ee (Cd | 
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ae ee ee is oes oe Po tet ee al te i 
|__| amphib alive | amphib inj| total amphib 
a | Ac A OS PR: A (RS «(| es 
|xbar| 0.46 | 0.54 | tT 004 | 0.04 | 08 | CT 
i ST CR (RN OR (N(R 
| sig | 0.76157731 | 0.813408 | 1.30930734 | 0.19794866| 0.197949|[0.27404752[ Oo [| o [| oO | 
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| starting values for the run Po 
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he | starting values for the run Yo SN z_ FANE ed 

|_| amphibs | crudes [ics | helo J 

pe BN Te oll 5 = Sa = SO aa TI 
eee | 


ae es rere ER (Re |e ed | | 
|__| amphib alive | amphib inj total amphib 
Ee RE a (ER 6 RY (A AS PR 2 ES (RR  , ( 
|xbar| 0.92 | 0.66 | 158 | 0.08 | 02 | 028 | oT 
2 SS (| 
| sig | 1.13999642 | 0.847806 | 1.34148866 | 0.34046787| 0.494872| 0.6074369[ Oo [| 0 [| oO | 
0.02279993 | 0.016956 | 0.02682977 | 0.00680936| 0.009897/0.01214874 o | 0 | o | 
af a | 
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| starting values for the run Po 
|__| amphibs | crudes | Ics [| helo J 
Pos 


Po 
[|__| amphib alive[ amphib inj[ total amphib total crudes helo alive] helo injured total helo 
1 0 0 


min 3 0 0 0 0 0 0 0 0 
xbar 2.92 0.08 1.38 0.32 1.7 0.04 0.08 | 0.12 0.04 0.04 0.08 
a 1 


3 
mx 3 ef es ee 
r sig | 0.39680733 | 0.595897 | 0 | 0.77958649] 0.551006 | 0.64681822 | 0.19796] 0.274| 0.326 [0.197949] 0.197947 [0.274048 
aS a ese [SR a (SOR) ES (SS Se ST 
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he | starting values for the run YSN _ ZANE 
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|_| amphib alive | amphib inj | total amphib 
EE (cS OE: RR (RE (| 
|xbar| 0.56 | 0.88 | 144 | 0.04 | 0.02 | 006 S| CT 
iS (ES) NS RN CY (NN (I (A  ( 
| sig | 0.90711474 | 1.002853 | 1.35766907 | 0.19794866| 0.141421[0.31363569[ Oo [| o [| oO | 
0.01814229 | 0.020057 | 0.02715338 | 0.00395897 | 0.002828/0.00627271| Oo | 0 | o | 
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he | starting values for the run YSN _ ZANE 
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|_| amphib alive | amphib inj | total amphib 
Ee (Ec DR ES PR (RR | (I (PR a 
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i 2 a) (ES a (ES eee (ee Pe 
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he | starting values for the run YSN _ ZANE 
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|__| amphib alive | amphib inj total amphib 
a EE (cE (A SR TR (OR «| (D(C 
pxbar| 1.32 | 0.56 | 188 | | 0.26 | 036 | OT 
2 LS (R(T | (| 
| sig | 1.26877733 | 0.812153 | 1.3192453 | 0.30304576| 0.443087| 0.5979557 [ Oo [| o [| oO | 
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| starting values for the run a Ds 
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a (Ce EE 
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he | starting values for the run a ae ee es 

|_| amphibs | crudes [ics | helo J 

eB oll = eS BO aa TS 
ee | 


ae ee re Ea | ce) (ey | ee 
|__| amphib alive| amphib inj total amphib 
Ppming oT 
pxbar| 1.640 | 0.44 | 208 088 4B 0 0 
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he | starting values for the run YSN _ ZANE 
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he | starting values for the run a ae ee es 

|_| amphibs | crudes [ics | helo PT 

eR (Di (eee (Cd | (A 
fe | 


ae ee ee Es |e ee) (es | 
|__| amphib alive| amphib inj total amphib 
Pminf oT 
pxbar| 1.04 | 0.64 | 168 | 6 2086 0.04 | 0.04 | 
pmax] 3 | 8 a 
| sig | 1.15987332 | 0.875051 | 1.30054933 | 0.50950156| 0.451754 | 0.69282032[ 0 [0.283] 0.283 
0.02319747 | 0.017501 | 0.02601099 | 0.01019003| 0.009035|0.01385641] 0 | 0.006] 0.006 
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he | starting values for the run YSN _ ZANE 
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Fe RR | (S(T AE | UE (MR (Fa a FT 
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sig | 1.09096475 | 0.817163 | 1.17872293 | 0.23989794| 0.50669 | 0.53604752/0.14142| 0.141| 0.198 
0.02181929 | 0.016343 | 0.02357446 | 0.00479796 | 0.010134 | 0.01072095 | 0.00283| 0.003 | 0.004 
a aa | | Aer (eee Rear) ee FOE ney (RS ES) (ES 


| | Sf amphib injfamphibs lost] | crudesinj| crudes lost| __| Ics inj |Ics lost| 
|xbar| | 084 2 TT 2 | 0.02 | 2.96 | 
— 


ee ee —— 
amphib alive total amphib 


le 
-/0O 


BY] CO] oo] oo 
O|O}]a|IN 
i 


ASA/BRIAIR 
OD] Oy} BR] oo} P 





Table 51 2 CRUDES 3 LCS-r0 Data Spreadsheet 
102 


0 





0 


CO] TH [COLO] MIN [co 


3 





oO 


0 


[|__| amphib alive[ amphib inj[ total amphib total crudes helo alive] helo injured total helo 











L5of 3 Jf oof 3 2 ft 





| sig {0 | 0 | 0  |0.37032804| 0.328261 | 0.19794866| 1.16567| 0.776 | 0.906 | 0.46291 | 0.3404679 | 0.595562 
lsigxb[ 0 | 0 | 0 | 0.00740656| 0.006566 | 0.00395897 | 0.02331| 0.016 | 0.018 [0.009258] 0.0068094 [0.011911 
fa os fie gf = fr ie i ef 
| [| famphib inj[amphibs lost] crudesinj| crudeslost{ [cs inj[Ics lost! helo injured 
[xbar[ Tt ees oss 0084.82 _ | 
a es ss  ( (( 
amphib alive| amphib inj | total amphib helo alive| helo injured 


ec 
S 
2 
o 
Ss 
= 
= 
2 
n 
o 
2 
o 
> 
fo) 
& 
| 
| 
o 
£ 
a 


48 3 
49 3 





Table 52 2 CRUDES 3 LCS-rl Data Spreadsheet 
103 


he | starting values for the run a ae ee es 
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he | starting values for the run YSN _ ZANE 
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pe BY ee el SS = OS eh 
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ae ee re Fs ee eee) 

|__| amphib alive| amphib inj total amphib 
Ppming oT 
pxbar| 2.94 | Tt 062182 1.18 | 1.1 | 2.28 | 
pmax] 3 | OT 8 8 8 
| sig | 0.42426407| 0 | 0.42426407 | 0.75592895| 0.666701 | 0.43752551 | 0.96235| 0.814 | 0.904 
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Table 58 


he | starting values for the run YSN _ ZANE 

|_| amphibs | crudes [ics | helo OT 

eR (Di) ieee ed ( | (A 
[rece toons 


ae ee ere is ods ee Poe ee al te I 
|_| amphib alive | amphib inj | total amphib 
ES a (6 SS PR (| SD 
pxbar| 14 | 0.62 | 72 | 014 | 02 | 034 | 0.02 | 0.02 | 
2 (| (ee 
| sig | 1.1111678 | 0.779586 | 1.35586406 | 0.40456578| 0.494872[0.65807387[ 0 [0.141] 0.141 
0.02222336 | 0.015592 | 0.02711728 | 0.00809132| 0.009897 |0.01316148] 0 | 0.003] 0.003 
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he | starting values for the run YSN _ ZANE 
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Table 62 2 CRUDES 3 LCS-rl1 Data Spreadsheet 


he | starting values for the run YSN _ ZANE 

|_| amphibs | crudes [ics | helo OT 
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[rece Seen 


ae es ee ER (Re (eee ed | 
|_| amphib alive | amphib inj | total amphib 
Ee SE a (6 (EA MS PE (RR) | 
pxbar| 1.82 0 | O7 | 252 | 00.28 | 058 | 0.02 | 0.02 | 
i a (SR) SR RS a | | 
| sig | 1.11921984 | 0.909137 | 0.90891278 | 0.6144518 | 0.453557 [0.75835483[ 0 [0.141] 0.141 
0.0223844 | 0.018183 | 0.01817826 | 0.01228904| 0.009071 | 0.0151671 | 0  [0.003[ 0.003 
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he | starting values for the run Yo SNM ZANE ed 

|_| amphibs | crudes [ics | helo TP 

(eR (Ree (ieee (| 
rece eee | 


ae ee rer EE | ee ee ee) 
|_| amphib alive] amphib inj | total amphib 
Ee A, (R(T (SR (RES NR (PE ea SE 
[xbar| 2.9 | 0.06 | 296 68 Tt 78 | 04 | 0.96 | 1.36 | 
sig | 0.41649656 | 0.313636 | 0.28284271 | 0.68332919| 0.303046 | 0.61577892 | 0.60609| 0.925 | 1.083 
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he | starting values for the run YSN _ ZANE 

|_| amphibs | crudes [ics | helo TP 

eR (Di (eee (Ce | 
Ur ce See = | 


ae ee ee ER (Re |e ed | 
|__| amphib alive | amphib inj | total amphib 
ER a (Rc a (EY RT («| (| 
pxbar| 1.72 | 074 | 246 | 0.24 | 0.32 | 056 | 0.12 | 0.12 | 
2 SS (N(R (| 
| sig | 1.1959114 | 0.921622 | 1.1104329 | 0.55549206| 0.586933 |0.76023627[ 0 [0.328] 0.328 
0.02391823 | 0.018432 | 0.02220866 | 0.01110984 | 0.011739 |0.01520473] 0 | 0.007] 0.007 
=f et ef 
|| Tf aamphibinj]amphibs lost] | crudesinj| crudes lost| __| Ics inj|Ics lost| 
Pxbar{ | 74 | 4A TT eT 0.12 | 3.88 | 
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2 CRUDES 4 LCS-r1 Data Spreadsheet 


Table 68 


el starting values for the run Po 
|_| amphibs | crudes | Ics | helo J 
ED RS a aa (ee QE Pee (Ree mg P| Ey 
pee Wea WP ee hae a ee — tt el 

|__| amphib alive | amphib inj | total amphib 
pminf 2 | 
|xbar| 296 | 0.04 | | BT | 054 | 1.42 | 1.96 | 


sig | 0.19794866 | 0.197949 | 0 | 0.72843136| 0.699854 | 0.75592895 | 0.73429| 1.012 | 1.245 
0.00395897 | 0.003959| 0 | 0.01456863| 0.013997 | 0.01511858|0.01469| 0.02 | 0.025 
a a ee | | 
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[sg | Oo J oOo fT of of oO fo 0.147427 0.141] 0 [1.025392] 0.9424241 [1.690791 
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Table 70 2 CRUDES 4 LCS-r3 Data Spreadsheet 


el starting values for the run Po 
|| amphibs | crudes | Ics | helo TT 
ER RS ae ae a I a Fee eee eed Pe 
as re ee ee a ee ~ tl 
|__| amphib alive | amphib inj | total amphib 
pminf of 9 | of of of oj o {o{o_ 
|xbar| 2.32 | 0.38 | 27 | 052 | 0.22 | 74 | 0.12 | 0.22 | 0.34 | 
ifakWe = Gane te ge ee ete ee ee lee 
T sig | 0.99877476 | 0.602376 | 0.73540215 | 0.81416039| 0.418452 | 0.87621636 | 0.32826] 0.616| 0.717 
0.0199755 | 0.012048 | 0.01470804 | 0.01628321 | 0.008369 [ 0.01752433 | 0.00657|0.012| 0.014 
SS eee Ee a a ae a Be Se eae 
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el starting values for the run Po 
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pe OMB NOS ill = AP | = ON 2 | 
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a starting values for the run Po 
| | amphibs [ crudes [Ics [helo J 
aa aR a aa (a ee (ee ee Fe (a 


RS wll | le il 
|__| amphib alive | amphib inj| total amphib 
min{ oF | oOo T[ oO T~ oo J{ o Tf oOo | Oo ~ of o | 
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| | amphibs [ices [| | 
Pe ets Se aE Se = i 


a a es (ee es (ee 
|__| amphib alive| amphib inj| total amphib 
Eo a a RE) RT (Se 
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| starting values for the run a ee eee 
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ey 


es Cee Seca meee ates eee 
PT amphib injfamphibs lost] [Ics inj] Ics lost ] 
pxbar| | 094 | 28 | 38.78 
a 





Table 215 0 CRUDES 4 LCS-r2 Data Spreadsheet 


266 


| _startingvaluesfortherun | | CT 
|_amphibs | ics | helo TT 
(lilo ed (en (TR Ce 
(ea PE | (| Sy | Oe Pe | 
inf Bs OB eo | 
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| starting values for the run a ee eee 
| | amphibs [ics [ | 
a ed (ee | Ge] 


oS Was ts es Toe aw Ls VW 
|__| amphib alive [ amphib inj | total amphib 
EE EE cS RR 5) (RE Fe 
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| starting values for the run a ee eee 
|| amphibs [ices [ | 
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| starting values for the run ufos Lt 8 __ It | 
| | amphibs [ies [| helo PT 
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|| starting values for the run ee ee eee 
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| starting values for the run ae a es (ey ee ey 
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| starting values for the run a ee eee 
| | amphibs [ices [ | 
a Rar eed (es |] 
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| starting values for the run a a ees (ey ee ee 
| | amphibs [ics [| helo OT a= ai ia 
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total Ics 
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| starting values for the run 2a fest 8st | 
| | amphibs [ics [| helo OT = i i 
Pep ss oe = st = 
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| starting values for the run a ee eee 
| | amphibs [| ices [| | 
a Rr eed (ee | Cd 
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| starting values for the run ufos Lt 8 __ It | 
| | amphibs [ies [| helo PT 
Ht 2} 8 | 8} ff 


a (|e (ae Pe OP | OS | || 

|__| amphib alive] amphib inj| total amphib helo injured 
bari SB | | Be 0 Se 
[xbar| 3 | 5G 4 | GT 18 | 112 | 2.92 
Er a DES (<< Ee eee) 
| sig | Oo | oo [0 [0.35051]0.351] 0 [| 1.2454 | 1.0811936 | 1.468583 
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| | starting values for the run a ee ee 
| | amphibs [ics [| | 
jb mil es if on — 


a ae ae ee ee eed eel 
|__| amphib alive] amphib inj| total amphib 
mn{ Oo f o 7  o | o f[ of o | 
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fe 223) Starting values for the run ees ee a (es es 
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|| starting values for the run ee ee eee 
| | amphibs [ics [| | CC 
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ee ee ee | 
|__| amphib alive [ amphib inj| total amphib 
Ee Rea (RR I A SY PP a] 
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|| starting values for the run ee ee eee 
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| starting values for the run a a ee) 
|| amphibs [| ics | helo | TT 
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APPENDIX B. DATA GROUPS FOR ANALYSIS 


A. INTRODUCTION 

This appendix displays the data groups by force mix prepared for analysis. Each 
table is broken into eight columns: number of CRUDES (CRUiser, DEStroyer, Frigate) 
ships assigned to the ESG, number of LCSs assigned to the ESG, the run-set observed, 
helo/UCAV (helicopter/Unmanned Combat Aerial Vehicle) factor status, Stealth status, 
Firepower status, speed status, and average total ship loss (the sum of amphibious ships, 
CRUDES ships, and LCSs lost). The number in the CRUDES column remains the same 
for a table because the groups are separated by the number of CRUDES ships assigned to 
the ESG. 
B. DATA GROUPS FOR ANALYSIS 
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APPENDIX C. S-PLUS CODE AND OUTPUT 


A. INTRODUCTION 

This appendix displays the S-Plus code used in analyzing the data and the output. 
Data frames were created from the spreadsheets in Annex B (Data Groups for Analysis) 
by using the Graphical User Interface. The “File” option was first selected, then import 
data. Next, the file with the data was found, selected, and the data frame named. The 
data frames are named crudesXdata, and the “X” signifies how many CRUDES ships 


were assigned to ESGs in the data group. 


Table 281’s code was written because S-Plus did not recognize numbers of LCSs 
(Littoral Combat Ships) to be a range of numbers. The other tables have S-Plus code and 
output used in the analysis. Key items are in bold font. If residuals and the number 
following residuals in the table are in bold, the ANOVA was rejected because there were 
too few residuals. If the number in the “Mean Sq” column, on the “Residuals” row, is in 
bold font, the ANOVA model was rejected because the Mean Square Error was not small 
enough. If whole lines in a table are in bold then the factor listed in the left column of the 
row effects ship loss. 

B. S-PLUS CODE AND OUTPUT 
> crudes2dataSLCS.f as.factor(crudes2data$LCs) 


> crudesldataSLCS.f as. factor (crudesldata$LCcs) 
> crudesOdata$LCS.f as.factor(crudesOdata$LCs) 








Table 281 S-Plus Code to allow numbers of LCSs to be recognized as a range 
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> allfact3.2c_aov(formula = tot.ship.loss ~ 

(LCS. £+HELO+STEALTH+FIREPOWER+SPEED)%*3, data = crudes2data) 
> plot (allfact3.2c) 

> summary (allfact3.2c) 









































































































































Df Sum of Sq Mean Sq F Value Pr (F) 

LcsS.f 4 4.0100 1.0025 17.941 0.0000015 

HELO 1 204.6080 204.6080 3661.733 0.0000000 

STEALTH 1 57.0882 57.0882 1021.669 0.0000000 

FIREPOWER 1 12.4031 12.4031 221.970 0.0000000 

SPEED 1 4.4462 4.4462 79.571 0.0000000 

LCS.£:HELO 4 2.5767 0.6442 11.528 0.0000413 

LCS.£:STEALTH 4 5.9270 1.4818 26.518 0.0000001 

LCS.£:FIREPOWER 4 0.9260 0.2315 4.143 0.0125266 

LCS.£:SPEED 4 0.1673 0.0418 0.748 0.5700467 

HELO:STEALTH 1 21.6112 21.6112 386.761 0.0000000 

HELO: FIREPOWER 1 3.2886 3.2886 58.854 0.0000002 

HELO:SPEED 1 0.0000 0.0000 0.001 0.9776283 

STEALTH: FIREPOWER 1 0.3672 0.3672 6.572 0.0181029 

STEALTH:SPEED 1 0.2442 0.2442 4.370 0.0489123 

FIREPOWER:SPEED 1 0.0110 0.0110 0.198 0.6611606 

LCS.£:HELO:STEALTH 4 8.1823 2.0456 36.608 0.0000000 

LCS.£:HELO:FIREPOWER 4 1.2244 0.3061 5.478 0.0035053 

LCS.f£:HELO:SPEED 4 0.0834 0.0208 0.373 0.8251777 

LCS.£:STEALTH: FIREPOWER 4 0.2971 0.0743 1.329 0.2918246 

LCS.£:STEALTH:SPEED 4 05:01:25 0.0031 0.056 0.9937063 

LCS.f£:FIREPOWER:SPEED 4 0.1582 0.0395 0.708 0.5956583 

HELO: STEALTH: FIREPOWER 1 1.4742 1.4742 26.384 0.0000435 

HELO:STEALTH:SPEED 1 0.5746 0.5746 10.283 0.0042365 

HELO: FIREPOWER:SPEED 1 0.2142 0.2142 3.834 0.0636347 

STEALTH: FIREPOWER:SPEED 1 0.0174 0.0174 0.311 0.5826719 
Residuals 21 1.1734 0.0559 





Table 282 S-Plus Code Preparing the ANOVA of the 2 CRUDES Set’s Total Ship 
Losses, Including Up to 3-Way Interactions, and Output 
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> allfact4.2c_aov(formula = tot.ship.loss ~ 

















































































































































































































































































































(LCS. £+HELO+STEALTH+FIREPOWER+SPEED)*4, data = crudes2data) 
> summary (allfact4.2c) 
Df Sum of Sq Mean Sq F Value Pr (F) 
LCS.£ 4 4.0100 1.0025 17.908 0.0080954 
HELO 1 204.6080 204.6080 3655.020 0.0000004 
STEALTH 1 57.0882 57.0882 1019.796 0.0000057 
FIREPOWER 1 12.4031 12.4031 221.564 0.0001186 
SPEED 1 4.4462 4.4462 79.426 0.0008763 
LCS.£:HELO 4 2.5767 0.6442 11.507 0.0181558 
LCS.f£:STEALTH 4 5.9270 1.4818 26.469 0.0038793 
LCS.f£:FIREPOWER 4 0.9260 0.2315 4.135 0.0989879 
LCS.£:SPEED 4 0.1673 0.0418 0.747 0.6078302 
HELO:STEALTH 1 21.6112 21.6112 386.052 0.0000396 
HELO:FIREPOWER 1 3.2886 3.2886 58.746 0.0015576 
HELO:SPEED 1 0.0000 0.0000 0.001 0.9787393 
STEALTH: FIREPOWER 1 0.3672 0.3672 6.560 0.0625607 
STEALTH:SPEED 1 0.2442 0.2442 4.362 0.1049936 
FIREPOWER:SPEED 1 0.0110 0.0110 0.197 0.6798793 
LCS.f£:HELO:STEALTH 4 8.1823 2.0456 36.541 0.0020908 
LCS.£:HELO:FIREPOWER 4 1.2244 0.3061 5.468 0.0643168 
LCS.£:HELO:SPEED 4 0.0834 0.0208 0.372 0.8190896 
LCS.£:STEALTH:FIREPOWER 4 0.2971 0.0743 1.327 0.3953270 
LCS.£:STEALTH:SPEED 4 0.0125 0.0031 0.056 0.9918852 
LCS.f£:FIREPOWER:SPEED 4 0.1582 0.0395 0.706 0.6277637 
HELO:STEALTH: FIREPOWER 1 1.4742 1.4742 26.335 0.0068301 
HELO:STEALTH:SPEED 1 0.5746 0.5746 10.264 0.0327812 
HELO: FIREPOWER:SPEED 1 0.2142 0.2142 3.827 0.1220694 
STEALTH: FIREPOWER: SPEED 1 0.0174 0.0174 0.311 0.6068496 
LCS.£:HELO:STEALTH:FIREPOWER 4 0.2516 0.0629 1.124 0.4564214 
LCS.£:HELO:STEALTH:SPEED 4 0.1236 0.0309 0.552 0.7104405 
LCS.f£:HELO:FIREPOWER:SPEED 4 0.4473 0.1118 1.997 0.2596301 
LCS.£:STEALTH: FIREPOWER:SPEED 4 0.0874 0.0219 0.390 0.8077521 
HELO: STEALTH: FIREPOWER:SPEED 1 0.0396 0.0396 0.707 0.4476239 
Residuals 4 0.2239 0.0560 


Table 283 S-Plus Code Preparing the ANOVA of the 2 CRUDES Set’s Total Ship 
Losses, Including Up to 4-Way Interactions, and Output 
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> allfact2.2c_aov(formula = tot.ship.loss ~ 
(LCS. £+HELO+STEALTH+FIREPOWER+SPEED)*2, data = crudes2data) 
> summary (allfact2.2c) 















































































































































Df Sum of Sq Mean Sq F Value Pr (F) 

LCS.f 4 4.0100 1.0025 3.6626 0.0109343 

HELO 1 204.6080 204.6080 747.5317 0.0000000 

STEALTH 1 57.0882 57.0882 208.5707 0.0000000 

FIREPOWER 1 12.4031 12.4031 45.3146 0.0000000 

SPEED 1 4.4462 4.4462 16.2443 0.0001938 

LCS.£:HELO 4 2.5767 0.6442 2.3535 0.0667771 

LCS.f£:STEALTH 4 5.9270 1.4818 5.4136 0.0010859 

LCS.f£:FIREPOWER 4 0.9260 0.2315 0.8458 0.5030647 

LCS.£:SPEED 4 0.1673 0.0418 0.1528 0.9608572 

HELO:STEALTH 1 21.6112 21.6112 78.9561 0.0000000 

HELO:FIREPOWER 1 3.2886 3.2886 12.0149 0.0011076 

HELO:SPEED 1 0.0000 0.0000 0.0002 0.9898218 

STEALTH: FIREPOWER 1 0.3672 0.3672 1.3416 0.2523704 

STEALTH:SPEED 1 0.2442 0.2442 0.8922 0.3495167 

FIREPOWER:SPEED 1 0.0110 0.0110 0.0404 0.8416241 
Residuals 49 13.4119 0.2737 








Table 284 S-Plus Code Preparing the ANOVA of the 2 CRUDES Set’s Total Ship 
Losses, Including Up to 2-Way Interactions, and Output 
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> allfact4.1c_aov(formula = tot.ship.loss ~ 


























































































































































































































































































































(LCS. £+HELO+STEALTH+FIREPOWER+SPEED)*4, data = crudesldata) 
> summary (allfact4.1c) 
Df Sum of Sq Mean Sq F Value Pr (F) 
LCS.£ 5 8.3928 1.6786 25.924 0.0013872 
HELO 1 304.0240 304.0240 4695.352 0.0000000 
STEALTH 1 144.3542 144.3542 2229.408 0.0000001 
FIREPOWER 1 33.3233 33.3233 514.645 0.0000031 
SPEED 1 1.6224 1.6224 25.056 0.0040850 
LCS.f£:HELO 5 4.9900 0.9980 15.413 0.0046565 
LCS.f£:STEALTH 5 4.2129 0.8426 13.013 0.0068335 
LCS.£:FIREPOWER 5 0.6875 O21 375 2.124 0.2140446 
LCS.£:SPEED 5 0.0265 0.0053 0.082 0.9921622 
HELO:STEALTH 1 48.0534 48.0534 742.137 0.0000012 
HELO:FIREPOWER 1 8.0042 8.0042 123.616 0.0001026 
HELO:SPEED 1 0.2440 0.2440 3.769 0.1098895 
STEALTH: FIREPOWER 1 0.2204 0.2204 3.404 0.1243415 
STEALTH:SPEED 1 0.5104 0.5104 7.883 0.0376525 
FIREPOWER:SPEED 1 0.0054 0.0054 0.083 0.7843346 
LCS.f:HELO:STEALTH 5 17.9690 3.5938 55.503 0.0002221 
LCS.£:HELO:FIREPOWER 5 2.9450 0.5890 9.097 0.0150264 
LCS.£:HELO:SPEED 5 0.0856 0.0171 0.265 0.9146304 
LCS.£: STEALTH: FIREPOWER 5 0.7443 0.1489 2.299 0.1910537 
LCS.£:STEALTH:SPEED 5 0.1950 0.0390 0.602 0.7041824 
LCS.£:FIREPOWER:SPEED 5 0.0881 0.0176 0.272 0.9101592 
HELO: STEALTH: FIREPOWER 1 3.7446 3.7446 57.832 0.0006246 
HELO:STEALTH:SPEED 1 0.2904 0.2904 4.485 0.0877534 
HELO: FIREPOWER:SPEED 1 0.4538 0.4538 7.008 0.0455791 
STEALTH: FIREPOWER: SPEED 1 0.0748 0.0748 2155 0%. 33151.93 
LCS.£:HELO:STEALTH: FIREPOWER 5 1.4373 0.2875 4.440 0.0637807 
LCS.£:HELO:STEALTH:SPEED 5 0.4546 0.0909 1.404 0.3592665 
LCS.f£:HELO: FIREPOWER:SPEED 5 0.5644 0.1129 1.743 0.2783540 
LCS.£:STEALTH: FIREPOWER:SPEED 5 0.1477 0.0295 0.456 0.7952754 
HELO: STEALTH: FIREPOWER:SPEED 1 0.0294 0.0294 0.454 0.5303048 
Residuals 5 0.3238 0.0648 


Table 285 S-Plus Code Preparing the ANOVA of the 1 CRUDES Set’s Total Ship 
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> alfact3mod.1c_aov(formula = tot.ship.loss ~ 

(LCS. £+HELO+STEALTH+FIREPOWER+SPEED) *3+LCS.f:HELO: STEALTH: FIREPOWER, 
data = crudesldata) 

> summary (alfact3mod.ic) 
















































































































































































Df Sum of Sq Mean Sq F Value Pr (F) 

Lcs.f 5 8.3928 1.6786 23.192 0.0000001 

HELO 1 304.0240 304.0240 4200.516 0.0000000 

STEALTH 1 144.3542 144.3542 1994.454 0.0000000 

FIREPOWER 1 33.3233 33.3233 460.407 0.0000000 

SPEED 1 1.6224 1.6224 22.416 0.0001124 

LCS.£:HELO 5 4.9900 0.9980 13.789 0.0000049 

LCS.£:STEALTH 5 4.2129 0.8426 11.641 0.0000177 

LCS.£:FIREPOWER 5 0.6875 0.1375 1.900 0.1372766 

LCS.£:SPEED 5 0.0265 0.0053 0.073 0.9956677 

HELO:STEALTH 1 48.0534 48.0534 663.925 0.0000000 

HELO: FIREPOWER 1 8.0042 8.0042 110.589 0.0000000 

HELO:SPEED 1 0.2440 0.2440 3.371 0.0805358 

STEALTH: FIREPOWER 1 0.2204 0.2204 3.045 0.0955858 

STEALTH:SPEED 1 0.5104 0.5104 7.052 0.0147939 

FIREPOWER:SPEED 1 0.0054 0.0054 0.075 0.7874095 

LCS.£:HELO:STEALTH 5 17.9690 3.5938 49.654 0.0000000 

LCS.£:HELO:FIREPOWER 5 2.9450 0.5890 8.138 0.0002114 

LCS.£:HELO:SPEED 5 0.0856 0.0171 0.237 0.9418963 

LCS.£:STEALTH: FIREPOWER 5 0.7443 0.1489 2.057 0.1117734 

LCS.£:STEALTH:SPEED 5 0.1950 0.0390 0.539 0.7446132 

LCS.£:FIREPOWER: SPEED 5 0.0881 0.0176 0.244 0.9384032 

HELO: STEALTH: FIREPOWER 1 3.7446 3.7446 51.737 0.0000004 

HELO:STEALTH:SPEED 1 0.2904 0.2904 4.012 0.0582456 

HELO: FIREPOWER:SPEED 1 0.4538 0.4538 6.269 0.0206068 

STEALTH: FIREPOWER: SPEED 1 0.0748 0.0748 1.034 0.3208633 

LCS.£:HELO:STEALTH:FIREPOWER 5 1.4373 0.2875 3.972 0.0108198 
Residuals 21 1.5199 0.0724 





Table 286 S-Plus Code Preparing the ANOVA of the 1 CRUDES Set’s Total Ship 
Losses, Including Up to 3-Way Interactions + a 4-Way Interaction, and 
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> allfact3.1c_aov(formula = tot.ship.loss ~ 
(LCS. £+HELO+STEALTH+FIREPOWER+SPEED)%*3, data = crudesldata) 
> summary (allfact3.1c) 



























































































































































































































































Df Sum of Sq Mean Sq F Value Pr (F) 
LES ;£ 5 8.3928 1.6786 14.758 0.0000007 
HELO 1 304.0240 304.0240 2672.934 0.0000000 
STEALTH 1 144.3542 144.3542 1269.140 0.0000000 
FIREPOWER 1 33.3233 33.3233 292.973 0.0000000 
SPEED 1 1.6224 1.6224 14.264 0.0008346 
LCS.f£:HELO 5 4.9900 0.9980 8.774 0.0000562 
LCS.£:STEALTH 5 4.2129 0.8426 7.408 0.0001961 
LCS.£:FIREPOWER 5 0.6875 0.1375 1.209 0.3327633 
LCS.£:SPEED 5 0.0265 0.0053 0.047 0.9985576 
HELO:STEALTH 1 48.0534 48.0534 422.478 0.0000000 
HELO:FIREPOWER 1 8.0042 8.0042 70.371 0.0000000 
HELO:SPEED 1 0.2440 0.2440 2.145 0.1549898 
STEALTH: FIREPOWER 1 0.2204 0.2204 1.938 0.1756940 
STEALTH:SPEED 1 0.5104 0.5104 4.488 0.0438596 
FIREPOWER:SPEED 1 0.0054 0.0054 0.047 0.8292159 
LCS.£:HELO:STEALTH 5 17.9690 3.5938 31.596 0.0000000 
LCS.£:HELO:FIREPOWER 5 2.9450 0.5890 5.178 0.0019866 
LCS.£:HELO:SPEED 5 0.0856 0.0171 0.151 0.9780434 
LCS.£:STEALTH:FIREPOWER 5 0.7443 0.1489 1.309 0.2909349 
LCS.£:STEALTH:SPEED 5 0.1950 0.0390 0.343 0.8820550 
LCS.£:FIREPOWER: SPEED 5 0.0881 0.0176 0.155 0.9766046 
HELO: STEALTH: FIREPOWER 1 3.7446 3.7446 32.922 0.0000049 
HELO:STEALTH:SPEED 1 0.2904 0.2904 2.553 0.1221581 
HELO: FIREPOWER:SPEED 1 0.4538 0.4538 3.989 0.0563553 
STEALTH: FIREPOWER:SPEED 1 0.0748 0.0748 0.658 0.4247082 
Residuals 26 2.9573 0.1137 
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> alfact4.0c_aov(formula = tot.ship.loss 














































































































































































































































































































(LCS. £+HELO+STEALTH+FIREPOWER+SPEED)%*4, data = crudesQdata) 
> summary (alfact4.0c) 
Df Sum of Sq Mean Sq F Value Pr (F) 
LCS.£ 4 6.1828 125457 100.01 0.0002921 
HELO 1 291.4661 291.4661 18859.02 0.0000000 
STEALTH 1 153.6242 153.6242 9940.10 0.0000001 
FIREPOWER 1 40.2996 40.2996 2607.54 0.0000009 
SPEED 1 0.0396 0.0396 2.56 0.1846723 
LCS.£:HELO 4 10.3625 2.5906 167.62 0.0001051 
LCS.f£:STEALTH 4 4.1066 1.0266 66.43 0.0006533 
LCS.£:FIREPOWER 4 0.3206 0.0802 5.19 0.0699411 
LCS.£:SPEED 4 0.2362 0.0591 3.82 0.1112233 
HELO:STEALTH 1 37.5106 37.5106 2427.09 0.0000010 
HELO: FIREPOWER 1 5.1918 5.1918 335.93 0.0000521 
HELO:SPEED 1 0.2856 0.2856 18.48 0.0126575 
STEALTH: FIREPOWER 1 Te 61 1.1761 76.10 0.0009512 
STEALTH:SPEED 1 0.0162 0.0162 1.05 0.3632013 
FIREPOWER:SPEED 1 0.0396 0.0396 2.56 0.1846723 
LCS.f£:HELO:STEALTH 4 18.1258 4.5315 293.20 0.0000346 
LCS.£:HELO:FIREPOWER 4 4.3364 1.0841 70.15 0.0005871 
LCS.£:HELO:SPEED 4 0.0322 0.0081 0.52 0.7282737 
LCS.£:STEALTH:FIREPOWER 4 0.3423 0.0856 5.54 0.0630439 
LCS.£:STEALTH:SPEED 4 0.1094 0.0273 1.77 0.2970071 
LCS.£:FIREPOWER:SPEED 4 0.0476 0.0119 0.77 0.5967675 
HELO:STEALTH: FIREPOWER 1 8.0011 8.0011 517.70 0.0000221 
HELO:STEALTH:SPEED 1 0.1022 0.1022 6.62 0.0618419 
HELO: FIREPOWER:SPEED 1 0.0530 0.0530 3.43 0.1375703 
STEALTH: FIREPOWER: SPEED 1 0.0361 0.0361 2.34 0.2010276 
LCS.£:HELO:STEALTH:FIREPOWER 4 1.9255 0.4814 31.15 0.0028428 
LCS.£:HELO:STEALTH:SPEED 4 0.1632 0.0408 2.64 0.1849889 
LCS.f£:HELO:FIREPOWER:SPEED 4 0.0324 0.0081 0.52 0.7267636 
LCS.£: STEALTH: FIREPOWER: SPEED 4 0.1951 0.0488 3.16 0.1458307 
HELO: STEALTH: FIREPOWER:SPEED 1 0.0018 0.0018 0.12 0.7497411 
Residuals 4 0.0618 0.0155 


Table 288 S-Plus Code Preparing the ANOVA of the 0 CRUDES Set’s Total Ship 
Losses, Including Up to 4-Way Interactions, and Output 


340 


> alfact3mod.0c_aov(formula = tot.ship.loss ~ 

(LCS. £+HELO+STEALTH+FIREPOWER+SPEED) *3+LCS.f:HELO: STEALTH: FIREPOWER, 
data = crudesOdata) 

> summary (alfact3mod. 0c) 







































































































































































Df Sum of Sq Mean Sq F Value Pr (F) 

Lcs.f 4 6.1828 1.5457 57.84 0.0000000 

HELO 1 291.4661 291.4661 10907.08 0.0000000 

STEALTH 1 153.6242 153.6242 5748.84 0.0000000 

FIREPOWER 1 40.2996 40.2996 1508.07 0.0000000 

SPEED 1 0.0396 0.0396 1.48 0.2400798 

LCS.£:HELO 4 10.3625 2.5906 96.94 0.0000000 

LCS.£:STEALTH 4 4.1066 1.0266 38.42 0.0000000 

LCS.£:FIREPOWER 4 0.3206 0.0802 3.00 0.0482526 

LCS.£:SPEED 4 0.2362 0.0591 ZeO1 OSLILA5 23 

HELO:STEALTH 1 37.5106 37.5106 1403.70 0.0000000 

HELO: FIREPOWER 1 5.1918 5.1918 194.28 0.0000000 

HELO:SPEED 1 0.2856 0.2856 10.69 0.0045207 

STEALTH: FIREPOWER 1 1.1761 1.1761 44.01 0.0000042 

STEALTH:SPEED 1 0.0162 0.0162 0.61 0.4462951 

FIREPOWER:SPEED 1 0.0396 0.0396 1.48 0.2400798 

LCS.£:HELO:STEALTH 4 18.1258 4.5315 169.57 0.0000000 

LCS.£:HELO:FIREPOWER 4 4.3364 1.0841 40.57 0.0000000 

LCS.f£:HELO:SPEED 4 0.0322 0.0081 0.30 0.8729508 

LCS.£:STEALTH:FIREPOWER 4 0.3423 0.0856 3.20 0.0393104 

LCS.£:STEALTH:SPEED 4 0.1094 0.0273 1.02 0.4234147 

LCS.f£:FIREPOWER:SPEED 4 0.0476 0.0119 0.45 0.7741740 

HELO: STEALTH: FIREPOWER 1 8.0011 8.0011 299.41 0.0000000 

HELO:STEALTH:SPEED 1 0.1022 0.1022 3.83 0.0670954 

HELO: FIREPOWER:SPEED 1 0.0530 0.0530 1.99 0.1768911 

STEALTH: FIREPOWER: SPEED 1 0.0361 0.0361 1.35 0.2610174 

LCS.£:HELO:STEALTH: FIREPOWER 4 1.9255 0.4814 18.01 0.0000061 
Residuals 17 0.4543 0.0267 
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> allfact3.0c_aov(formula = tot.ship.loss ~ 
(LCS. £+HELO+STEALTH+FIREPOWER+SPEED) *3, data = crudesQdata) 
> summary (allfact3.0c) 












































































































































































































































Df Sum of Sq Mean Sq F Value Pr (F) 
LCS.f 4 6.1828 1.5457 13.640 0.0000124 
HELO 1 291.4661 291.4661 2571.992 0.0000000 
STEALTH 1 153.6242 153.6242 1355.631 0.0000000 
FIREPOWER 1 40.2996 40.2996 355.617 0.0000000 
SPEED 1 0.0396 0.0396 0.349 0.5607135 
LCS.£:HELO 4 10.3625 2.5906 22.861 0.0000002 
LCS.f£:STEALTH 4 4.1066 1.0266 9.059 0.0002047 
LCS.f£:FIREPOWER 4 0.3206 0.0802 0.707 0.5959113 
LCS.£:SPEED 4 0.2362 0.0591 0.524 0.5721 2051 
HELO:STEALTH 1 37.5106 37.5106 331.006 0.0000000 
HELO:FIREPOWER 1 5.1918 5.1918 45.814 0.0000011 
HELO:SPEED 1 0.2856 0.2856 2.520 0.1273348 
STEALTH: FIREPOWER 1 1.1761 1.1761 10.379 0.0040933 
STEALTH:SPEED 1 0.0162 0.0162 0.143 0.7087727 
FIREPOWER:SPEED 1 0.0396 0.0396 0.349 0.5607135 
LCS.f£:HELO:STEALTH 4 18.1258 4.5315 39.987 0.0000000 
LCS.£:HELO:FIREPOWER 4 4.3364 1.0841 9.566 0.0001445 
LCS.f£:HELO:SPEED 4 0.0322 0.0081 0.071 0.9901003 
LCS.£:STEALTH:FIREPOWER 4 0.3423 0.0856 0.755 0.5658939 
LCS.£:STEALTH:SPEED 4 0.1094 0.0273 0.241 0.9116963 
LCS.f£:FIREPOWER:SPEED 4 0.0476 0.0119 0.105 0.9794778 
HELO: STEALTH: FIREPOWER 1 8.0011 8.0011 70.605 0.0000000 
HELO:STEALTH:SPEED 1 0.1022 0.1022 0.902 0.3529854 
HELO: FIREPOWER:SPEED 1 0.0530 0.0530 0.468 0.5013499 
STEALTH: FIREPOWER:SPEED 1 0.0361 0.0361 0.319 0.5783242 
Residuals 21 2.3798 0.1133 
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A. 


APPENDIX D. GRAPHS 


INTRODUCTION 
This appendix displays graphs of residual plots for chosen ANOVA models and 


run-set comparisons. The run-set comparisons are categorized by what factors they 


isolate. 


B. 


Residuals 


RESIDUAL PLOTS 
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Fitted : (LCS.f + HELO + STEALTH + FIREPOWER + SPEED)‘*3 + LCS.f:HELO:STEALTH:FIREPOWER 


Figure 18 Residual Plot for the 1 CRUDES ANOVA 
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Residuals 


0.1 


0.0 


-0.1 


Fitted : (LCS.f + HELO + STEALTH + FIREPOWER + SPEED)‘3 + LCS.f:HELO:STEALTH:FIREPOWER 
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Figure 19 Residual Plot for the 0 CRUDES ANOVA 
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C. 


Mean Total Ship Loss 


Mean Total Ship Loss 


HELO/UCAV COMPARISONS 


2 Crudes+ x LCSs 
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Figure 21 


Number of LCSs 


2 CRUDES + X LCS, Ship Loss vs. Number of LCS, r4 and r5 
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Mean Total Ship Loss 


Mean Total Ship Loss 


1 Crudes+ x LCSs 
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Figure 22. 1 CRUDES + X LCS, Ship Loss vs. Number of LCS, r6 and 17 
1 Crudes+ x LCSs 
3 
2 
4.5. e114 
S115 
; 
° Pn 
0 : Sd 
2 3 4 5 6 7 


Number of LCSs 


Figure 23. 1 CRUDES + X LCS, Ship Loss vs. Number of LCS, r14 and r15 
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0 Crudes+ x LCSs 
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Figure 25 0 CRUDES + X LCS, Ship Loss vs. Number of LCS, r10 and rl1 
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D. 
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Figure 26 2CRUDES + X LCS, Ship Loss vs. Number of LCS, r0 and 12 
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Figure 27 2 CRUDES + X LCS, Ship Loss vs. Number of LCS, rl and 13 
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Mean Total Ship Loss 


Mean Total Ship Loss 


1 Crudes+ x LCSs 
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Figure 28 1 CRUDES + X LCS, Ship Loss vs. Number of LCS, r8 and r10 
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Figure 29 1 CRUDES + X LCS, Ship Loss vs. Number of LCS, r0 and 12 
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0 Crudes+ x LCSs 
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Figure 30 0 CRUDES + X LCS, Ship Loss vs. Number of LCS, rl12 and r14 
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Figure 31 0 CRUDES + X LCS, Ship Loss vs. Number of LCS, r13 and r15 
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E. FIREPOWER COMPARISONS 


2 Crudes+ x LCSs 
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Figure 32. 2 CRUDES + X LCS, Ship Loss vs. Number of LCS, r2 and r6 
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Figure 33. 2 CRUDES + X LCS, Ship Loss vs. Number of LCS, r9 and r13 
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Figure 34 
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1 CRUDES + X LCS, Ship Loss vs. Number of LCS, rl and r5 
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Figure 35 
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1 CRUDES + X LCS, Ship Loss vs. Number of LCS, r3 and r7 
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0 Crudes+ x LCSs 
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Figure 36 0 CRUDES + X LCS, Ship Loss vs. Number of LCS, r9 and r13 
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Figure 37 0 CRUDES + X LCS, Ship Loss vs. Number of LCS, rl0 and r14 
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F. SPEED COMPARISONS 


2 Crudes+ x LCSs 
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Figure 38 2 CRUDES + X LCS, Ship Loss vs. Number of LCS, rl and 19 
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Figure 39 2CRUDES + X LCS, Ship Loss vs. Number of LCS, r5 and r13 
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Figure 40 


Number of LCSs 


1 CRUDES + X LCS, Ship Loss vs. Number of LCS, rl and r9 
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Figure 41 
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1 CRUDES + X LCS, Ship Loss vs. Number of LCS, r6 and r14 
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Figure 42 0 CRUDES + X LCS, Ship Loss vs. Number of LCS, rl and 19 
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Figure 43. 0 CRUDES + X LCS, Ship Loss vs. Number of LCS, r6 and r14 
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